00000001:02000400:0.0F:1789776286.465483:0:2948:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing set_hostid 00000001:02000400:0.0:1789776295.322924:0:3151:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing load_modules_local 00000001:01000000:1.0F:1789776296.500696:0:3211:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 463 MB/s 00000001:01000000:1.0:1789776296.751032:0:3211:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 563 MB/s 00000001:01000000:2.0F:1789776297.000694:0:3211:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 5095 MB/s 00000020:02000000:3.0F:1789776298.010935:0:3242:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_111_g8cb7ca1 00000400:02000000:1.0:1789776298.814078:0:3257:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.202.106@tcp [8/256/0/180] 00008000:02000000:2.0:1789776302.901845:0:3407:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1789776354.584206:0:5212:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789776365.314625:0:5791:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789776365.314632:0:5791:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1789776365.314764:0:5791:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000007aa40aba 00000080:02000400:3.0:1789776365.314775:0:5791:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1789776365.321728:0:5791:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1789776365.321744:0:5791:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789776365.321819:0:5791:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000321ed9c2) 00000020:00000080:3.0:1789776365.321839:0:5791:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789776365.355730:0:5791:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1789776365.358252:0:5791:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1789776365.406080:0:5791:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789776365.406129:0:5791:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789776365.406150:0:5791:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789776365.406200:0:5791:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789776365.406258:0:5791:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789776365.406637:0:5791:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789776365.406645:0:5791:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789776365.406655:0:5791:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x26940258de8eed71 00000020:01000004:3.0:1789776365.406664:0:5791:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1789776365.406670:0:5791:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789776365.406675:0:5791:0:(tgt_mount.c:101:server_register_mount()) register mount 000000007aa40aba from MGS 00000020:01000004:3.0:1789776365.406680:0:5791:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789776365.406689:0:5791:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000ca6238f9) 00000020:00000080:3.0:1789776365.406698:0:5791:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789776365.406768:0:5791:0:(tgt_mount.c:153:server_get_mount()) get mount 000000007aa40aba from MGS, refs=2 00080000:01000000:3.0:1789776365.406774:0:5791:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789776365.406779:0:5791:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x26940258de8eed7f 00000100:00100000:3.0:1789776365.406876:0:5791:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789776365.407043:0:5791:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789776365.407050:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789776365.408871:0:5791:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789776365.408883:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1789776365.409697:0:5791:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789776365.409929:0:5791:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1789776365.409935:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789776365.410827:0:5791:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789776365.410836:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1789776365.411145:0:5791:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1789776365.411151:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789776365.411698:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776365.411702:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776365.411703:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776365.411936:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776365.411939:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776365.411940:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776365.417160:0:5791:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789776365.420582:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1789776365.668684:0:5791:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2674 MB/s 00000001:01000000:3.0:1789776365.920329:0:5791:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3039 MB/s 00000001:01000000:3.0:1789776366.172691:0:5791:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 361 MB/s 00000001:01000000:1.0:1789776366.430345:0:5791:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 593 MB/s 00080000:10000000:2.0:1789776366.454434:0:5791:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:3.0:1789776366.486662:0:5791:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1789776366.486679:0:5791:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789776366.486682:0:5791:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00010000:00010000:1.0:1789776366.487085:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789776366.495349:0:5802:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1789776366.495426:0:5791:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1789776366.495483:0:5791:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1789776366.495750:0:5791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1789776366.495775:0:5791:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1789776366.513897:0:5791:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789776366.516382:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1789776366.516392:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789776366.525500:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789776366.525525:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1789776366.537021:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1789776366.537039:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1789776366.538174:0:5791:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1789776366.538201:0:5791:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.106@tcp' 00000020:01000004:1.0:1789776366.538204:0:5791:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789776366.538315:0:5791:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.106@tcp (typ=mgc) 00000020:00000080:1.0:1789776366.538336:0:5791:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.106@tcp (0000000001f5da16) 00000020:00000080:1.0:1789776366.538357:0:5791:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789776366.538496:0:5791:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000e0983820@MGC192.168.202.106@tcp: add connection 192.168.202.106@tcp at head 00010000:00010000:1.0:1789776366.538706:0:5791:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.106@tcp-0 is initialized 00000040:01000000:1.0:1789776366.538714:0:5791:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.106@tcp ctxt 1 is initialized 00000100:00080000:0.0:1789776366.539071:0:5807:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1789776366.541962:0:5808:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1789776366.542044:0:5791:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.106@tcp (uuid 9db43398-240e-4f78-8778-c11d527e09a1) 00000020:00000080:1.0:1789776366.542069:0:5791:0:(genops.c:1385:class_connect()) connect: client 9db43398-240e-4f78-8778-c11d527e09a1, cookie 0x26940258de8eed8d 00000100:00080000:1.0:1789776366.542083:0:5791:0:(import.c:510:import_select_connection()) MGC192.168.202.106@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789776366.542089:0:5791:0:(import.c:624:import_select_connection()) MGC192.168.202.106@tcp: import 00000000e0983820 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1789776366.542148:0:5791:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a7dd5ab7 x1876716471451776/t0(0) o250->MGC192.168.202.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789776366.542181:0:5791:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 9db43398-240e-4f78-8778-c11d527e09a1->MGS 00000020:01000004:1.0:1789776366.542204:0:5791:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1789776366.542209:0:5791:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1789776366.542245:0:5791:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000c75b94aa) 00000020:00000080:1.0:1789776366.542264:0:5791:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789776366.542768:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a7dd5ab7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9db43398-240e-4f78-8778-c11d527e09a1:3272:1876716471451776:0@lo:250: 00000100:00100000:0.0:1789776366.542872:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776366.543101:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471451776 00000100:00100000:3.0:1789776366.543112:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471451776 00000100:00100000:3.0:1789776366.543155:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789776366.543172:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009522a404 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3272:x1876716471451776:12345-0@lo:250: 00010000:00080000:3.0:1789776366.543200:0:5804:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 9db43398-240e-4f78-8778-c11d527e09a1@0@lo t0 exp 0000000000000000 cur 119 last 0 00000020:00000080:3.0:1789776366.543239:0:5804:0:(genops.c:1385:class_connect()) connect: client 9db43398-240e-4f78-8778-c11d527e09a1, cookie 0x26940258de8eed9b 00000100:00080000:3.0:1789776366.543360:0:5804:0:(import.c:65:import_set_state_nolock()) 000000005f716f1b : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789776366.543449:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009522a404 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+5:3272:x1876716471451776:12345-0@lo:250: Request processed in 277us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776366.543458:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789776366.543509:0:3272:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.106@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1789776366.543519:0:3272:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.106@tcp: connect to target with instance 0 00000100:00080000:3.0:1789776366.543526:0:3272:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.106@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1789776366.543531:0:3272:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1789776366.543534:0:3272:0:(import.c:65:import_set_state_nolock()) 00000000e0983820 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1789776366.543536:0:3272:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1789776366.543548:0:3272:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1789776366.543554:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a7dd5ab7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9db43398-240e-4f78-8778-c11d527e09a1:3272:1876716471451776:0@lo:250: 00000100:00100000:1.0:1789776366.572427:0:5791:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789776366.573921:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789776366.573929:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789776366.575770:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789776366.575780:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789776366.589933:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789776366.590023:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1789776366.590996:0:5791:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789776366.591171:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1789776366.591175:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1789776366.591942:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1789776366.591949:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1789776366.650591:0:5791:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789776366.650862:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789776366.650869:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1789776366.652689:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1789776366.652704:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1789776366.653616:0:5791:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789776366.653836:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789776366.653849:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1789776366.654525:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789776366.654532:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1789776366.655707:0:5791:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789776366.655926:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789776366.655932:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1789776366.656835:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789776366.656844:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1789776366.660183:0:5791:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789776366.660605:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789776366.660611:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789776366.661156:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789776366.661163:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789776366.686417:0:5791:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789776366.686736:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789776366.686743:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789776366.688388:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789776366.688400:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789776366.698608:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789776366.698622:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789776366.699627:0:5791:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789776366.699651:0:5791:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1789776366.699659:0:5791:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.106@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789776366.699805:0:5791:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.106@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789776366.699841:0:5791:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.106@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1789776366.699846:0:5791:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789776366.699848:0:5791:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789776366.699849:0:5791:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789776366.699851:0:5791:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789776366.699852:0:5791:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789776366.699853:0:5791:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789776366.699855:0:5791:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789776366.699856:0:5791:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789776366.699858:0:5791:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789776366.699859:0:5791:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789776366.699861:0:5791:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789776366.699862:0:5791:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789776366.699865:0:5791:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1789776366.699867:0:5791:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789776366.699868:0:5791:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789776366.699870:0:5791:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789776366.699871:0:5791:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789776366.699872:0:5791:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789776366.699873:0:5791:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789776366.699874:0:5791:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789776366.699875:0:5791:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789776366.699875:0:5791:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789776366.699876:0:5791:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789776366.699877:0:5791:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789776366.699884:0:5791:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789776366.699925:0:5791:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789776366.699947:0:5791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007bf97af0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:5791:1876716471451904:0@lo:253: 00000100:00100000:1.0:1789776366.700043:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776366.700151:0:5791:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d3e6f823 going to sleep for 11 seconds 00000100:00100000:2.0:1789776366.708813:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471451904 00000100:00100000:2.0:1789776366.708832:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471451904 00000100:00100000:2.0:1789776366.708956:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789776366.708968:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007190feae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+5:5791:x1876716471451904:12345-0@lo:253: 20000000:01000000:2.0:1789776366.709027:0:5806:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789776366.709030:0:5806:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1789776366.710149:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1789776366.710259:0:5806:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1789776366.710627:0:5806:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789776366.711728:0:5828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1789776366.715710:0:5806:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789776366.715716:0:5806:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1789776366.715722:0:5806:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1789776366.715724:0:5806:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1789776366.715733:0:5806:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1789776366.715969:0:5806:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789776366.716151:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1789776366.716163:0:5806:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789776366.716206:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1789776366.717665:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1789776366.717719:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1789776366.717842:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1789776366.717854:0:5806:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1789776366.717921:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1789776366.717929:0:5806:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1789776366.717989:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1789776366.717997:0:5806:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1789776366.718027:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1789776366.718072:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1789776366.718105:0:5806:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1789776366.718111:0:5806:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1789776366.718125:0:5806:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789776366.718382:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1789776366.718395:0:5806:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789776366.718799:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1789776366.718841:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1789776366.718883:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1789776366.718893:0:5806:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1789776366.718946:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1789776366.718951:0:5806:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1789776366.718975:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1789776366.718993:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1789776366.719009:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1789776366.719015:0:5806:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1789776366.719059:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1789776366.719067:0:5806:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1789776366.719097:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1789776366.719128:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1789776366.719286:0:5806:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1789776366.719333:0:5806:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1789776366.719340:0:5806:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1789776366.724817:0:5829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1789776366.725718:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1789776366.725748:0:5806:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.106@tcp for mdt 20000000:01000000:0.0:1789776366.725761:0:5806:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.106@tcp (null) (null) (null) 00000040:00080000:0.0:1789776366.725802:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1789776366.725809:0:5806:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789776366.725834:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1789776366.725841:0:5806:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.106@tcp (null) (null) 00000040:00080000:0.0:1789776366.725882:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1789776366.725892:0:5806:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1789776366.725919:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1789776366.725950:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1789776366.726023:0:5806:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789776366.726026:0:5806:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789776366.726039:0:5806:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1789776366.726045:0:5806:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1789776366.727699:0:5830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:1.0:1789776366.729656:0:5806:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1789776366.740148:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1789776366.740202:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:0.0:1789776366.740827:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:0.0:1789776366.740847:0:5806:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789776366.740850:0:5806:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789776366.740853:0:5806:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789776366.740865:0:5806:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789776366.740867:0:5806:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789776366.740901:0:5806:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789776366.740904:0:5806:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789776366.743653:0:5831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:0.0:1789776366.744050:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:0.0:1789776366.744097:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:0.0:1789776366.744172:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:0.0:1789776366.744185:0:5806:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789776366.744187:0:5806:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789776366.744994:0:5832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1789776366.745189:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1789776366.745894:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1789776366.745944:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1789776366.745957:0:5806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789776366.745959:0:5806:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:0.0:1789776366.745967:0:5806:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789776366.745989:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c052fe8b/0x26940258de8eeda2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776366.746009:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c052fe8b/0x26940258de8eeda2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776366.746020:0:5806:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c052fe8b/0x26940258de8eeda2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776366.746040:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c052fe8b/0x26940258de8eeda2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776366.746047:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c052fe8b/0x26940258de8eeda2 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776366.746053:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c052fe8b/0x26940258de8eeda2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776366.746060:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c052fe8b already unused, calling callback (00000000aa3fe46b) 00010000:00010000:0.0:1789776366.746064:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c052fe8b/0x26940258de8eeda2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776366.746072:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c052fe8b/0x26940258de8eeda2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776366.746088:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c052fe8b/0x26940258de8eeda2 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776366.746096:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c052fe8b/0x26940258de8eeda2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776366.746102:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c052fe8b/0x26940258de8eeda2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789776366.746121:0:5806:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789776366.988684:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007190feae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+5:5791:x1876716471451904:12345-0@lo:253: Request processed in 279711us (288633us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776366.988704:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789776366.988939:0:5791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007bf97af0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:5791:1876716471451904:0@lo:253: 10000000:01000000:0.0:1789776366.988958:0:5791:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789776366.988962:0:5791:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789776366.988964:0:5791:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789776366.988982:0:5791:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789776366.988983:0:5791:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1789776366.988985:0:5791:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789776366.988987:0:5791:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789776366.988988:0:5791:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789776366.988989:0:5791:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789776366.988991:0:5791:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789776366.988993:0:5791:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789776366.988995:0:5791:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789776366.989018:0:5791:0:(tgt_mount.c:101:server_register_mount()) register mount 000000007aa40aba from lustre-MDT0000 10000000:01000000:0.0:1789776366.989046:0:5791:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789776366.989049:0:5791:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789776366.989054:0:5791:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9c86aa63b370 10000000:01000000:0.0:1789776366.989058:0:5791:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789776366.989067:0:5791:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c86aa63b370 from 1 10000000:01000000:0.0:1789776366.989070:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789776366.989130:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: 00000000c052fe8b/0x26940258de8eeda9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776366.989142:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: 00000000c052fe8b/0x26940258de8eeda9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776366.989152:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: 00000000c052fe8b/0x26940258de8eeda9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776366.989173:0:5791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b7cd361a pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:5791:1876716471452032:0@lo:101: 00000100:00100000:0.0:1789776366.989254:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776366.989417:0:5791:0:(client.c:2715:ptlrpc_set_wait()) set 00000000edfd0448 going to sleep for 11 seconds 00000100:00100000:1.0:1789776366.989556:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471452032 00000100:00100000:1.0:1789776366.989565:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471452032 00000100:00100000:1.0:1789776366.989623:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789776366.989633:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000005f3d244 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+5:5791:x1876716471452032:12345-0@lo:101: 00010000:00010000:1.0:1789776366.989648:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776366.989666:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a4194c05/0x26940258de8eedb0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8eeda9 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776366.989693:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a4194c05/0x26940258de8eedb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8eeda9 expref: 6 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776366.989703:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a4194c05/0x26940258de8eedb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8eeda9 expref: 6 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776366.989712:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a4194c05, rc 0) 00000100:00100000:1.0:1789776366.989826:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000005f3d244 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+6:5791:x1876716471452032:12345-0@lo:101: Request processed in 194us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776366.989833:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789776366.989957:0:5791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b7cd361a pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:5791:1876716471452032:0@lo:101: 00010000:00010000:0.0:1789776366.989975:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: 00000000c052fe8b/0x26940258de8eeda9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eedb0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776366.989985:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: 00000000c052fe8b/0x26940258de8eeda9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8eedb0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776366.990045:0:5791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b7cd361a pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:5791:1876716471452160:0@lo:501: 00000100:00100000:0.0:1789776366.990072:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776366.990096:0:5791:0:(client.c:2715:ptlrpc_set_wait()) set 00000000edfd0448 going to sleep for 11 seconds 00000100:00100000:1.0:1789776366.990153:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471452160 00000100:00100000:1.0:1789776366.990164:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471452160 00000100:00100000:1.0:1789776366.990192:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789776366.990197:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000050d9dbe0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+6:5791:x1876716471452160:12345-0@lo:501: 00000100:00100000:1.0:1789776366.990843:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000050d9dbe0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+6:5791:x1876716471452160:12345-0@lo:501: Request processed in 644us (769us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789776366.990851:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789776366.991146:0:5791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b7cd361a pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:5791:1876716471452160:0@lo:501: 10000000:01000000:2.0:1789776366.991176:0:5791:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789776366.991463:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: 00000000c052fe8b/0x26940258de8eeda9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eedb0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776366.991482:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: 00000000c052fe8b/0x26940258de8eeda9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eedb0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776366.991489:0:5791:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c86c01a7000 10000000:01000000:2.0:1789776366.991494:0:5791:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789776366.991498:0:5791:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c86c01a7000 10000000:01000000:2.0:1789776366.991501:0:5791:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789776366.991504:0:5791:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9c86c01a7000 from 1 10000000:01000000:2.0:1789776366.991506:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789776366.991546:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: 000000003339ae30/0x26940258de8eedb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776366.991553:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: 000000003339ae30/0x26940258de8eedb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776366.991562:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: 000000003339ae30/0x26940258de8eedb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776366.991588:0:5791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008c4fbc5f pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:5791:1876716471452288:0@lo:101: 00000100:00100000:2.0:1789776366.991625:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776366.991666:0:5791:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e942cfe5 going to sleep for 11 seconds 00000100:00100000:3.0:1789776366.991732:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471452288 00000100:00100000:3.0:1789776366.991738:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471452288 00000100:00100000:3.0:1789776366.991855:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789776366.991872:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008428488b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+6:5791:x1876716471452288:12345-0@lo:101: 00010000:00010000:3.0:1789776366.991883:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776366.991897:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004cdb9aba/0x26940258de8eedbe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8eedb7 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776366.991919:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004cdb9aba/0x26940258de8eedbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8eedb7 expref: 7 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776366.991929:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004cdb9aba/0x26940258de8eedbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8eedb7 expref: 7 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776366.991937:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004cdb9aba, rc 0) 00000100:00100000:3.0:1789776366.991980:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008428488b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+7:5791:x1876716471452288:12345-0@lo:101: Request processed in 110us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776366.991986:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789776366.992063:0:5791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008c4fbc5f pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:5791:1876716471452288:0@lo:101: 00010000:00010000:2.0:1789776366.992076:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: 000000003339ae30/0x26940258de8eedb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eedbe expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776366.992085:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: 000000003339ae30/0x26940258de8eedb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8eedbe expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776366.992112:0:5791:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789776366.992425:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: 000000003339ae30/0x26940258de8eedb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eedbe expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776366.992433:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: 000000003339ae30/0x26940258de8eedb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eedbe expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776366.992440:0:5791:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789776366.992444:0:5791:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789776366.992449:0:5791:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c86c01a7000 10000000:01000000:2.0:1789776366.992451:0:5791:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789776366.992454:0:5791:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1789776366.992455:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789776366.992471:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: 00000000f0ab960b/0x26940258de8eedc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776366.992477:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: 00000000f0ab960b/0x26940258de8eedc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776366.992484:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: 00000000f0ab960b/0x26940258de8eedc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776366.992498:0:5791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008c4fbc5f pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:5791:1876716471452416:0@lo:101: 00000100:00100000:2.0:1789776366.992526:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776366.992555:0:5791:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e942cfe5 going to sleep for 11 seconds 00000100:00100000:1.0:1789776366.992616:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471452416 00000100:00100000:1.0:1789776366.992622:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471452416 00000100:00100000:1.0:1789776366.992657:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789776366.992663:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043151a24 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+7:5791:x1876716471452416:12345-0@lo:101: 00010000:00010000:1.0:1789776366.992671:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776366.992681:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005d4c3d33/0x26940258de8eedcc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8eedc5 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776366.992695:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005d4c3d33/0x26940258de8eedcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8eedc5 expref: 8 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776366.992703:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005d4c3d33/0x26940258de8eedcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8eedc5 expref: 8 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776366.992711:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005d4c3d33, rc 0) 00000100:00100000:1.0:1789776366.992746:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043151a24 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+8:5791:x1876716471452416:12345-0@lo:101: Request processed in 83us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776366.992759:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789776366.992921:0:5791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008c4fbc5f pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:5791:1876716471452416:0@lo:101: 00010000:00010000:2.0:1789776366.992932:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: 00000000f0ab960b/0x26940258de8eedc5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eedcc expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776366.992951:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: 00000000f0ab960b/0x26940258de8eedc5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8eedcc expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776366.992996:0:5791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008c4fbc5f pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:5791:1876716471452544:0@lo:501: 00000100:00100000:2.0:1789776366.993022:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776366.993041:0:5791:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e942cfe5 going to sleep for 11 seconds 00000100:00100000:1.0:1789776366.993088:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471452544 00000100:00100000:1.0:1789776366.993092:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471452544 00000100:00100000:1.0:1789776366.993123:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789776366.993129:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f0216648 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+8:5791:x1876716471452544:12345-0@lo:501: 00000100:00100000:1.0:1789776366.993619:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f0216648 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+9:5791:x1876716471452544:12345-0@lo:501: Request processed in 490us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776366.993632:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789776366.993704:0:5791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008c4fbc5f pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:5791:1876716471452544:0@lo:501: 00000100:00100000:2.0:1789776366.993730:0:5791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008c4fbc5f pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:5791:1876716471452672:0@lo:503: 00000100:00100000:2.0:1789776366.993834:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776366.993863:0:5791:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e942cfe5 going to sleep for 11 seconds 00000100:00100000:3.0:1789776366.993922:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471452672 00000100:00100000:3.0:1789776366.993927:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471452672 00000100:00100000:3.0:1789776366.993958:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789776366.993965:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae5e1517 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+9:5791:x1876716471452672:12345-0@lo:503: 00000100:00100000:3.0:1789776366.994126:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae5e1517 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+9:5791:x1876716471452672:12345-0@lo:503: Request processed in 162us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776366.994132:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789776366.994254:0:5791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008c4fbc5f pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:5791:1876716471452672:0@lo:503: 00000100:00100000:1.0:1789776366.994934:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009cdd0991 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:5834:1876716471452800:0@lo:502: 00000100:00100000:1.0:1789776366.994987:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776366.995021:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bfb156f1 going to sleep for 11 seconds 00000100:00100000:2.0:1789776366.995076:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471452800 00000100:00100000:2.0:1789776366.995081:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471452800 00000100:00100000:2.0:1789776366.995120:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789776366.995128:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000090e9a65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+9:5834:x1876716471452800:12345-0@lo:502: 00000100:00100000:2.0:1789776366.995560:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000090e9a65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+9:5834:x1876716471452800:12345-0@lo:502: Request processed in 432us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776366.995568:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789776366.995675:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009cdd0991 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:5834:1876716471452800:0@lo:502: 00000020:01000000:1.0:1789776366.995699:0:5834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789776366.995709:0:5834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776366.995712:0:5834:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789776366.995719:0:5834:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789776366.995722:0:5834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789776366.995734:0:5834:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000003a990466) 00000020:00000080:1.0:1789776366.995822:0:5834:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789776366.995830:0:5834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789776366.995889:0:5834:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789776366.995895:0:5834:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x26940258de8eedda 00000020:00000080:1.0:1789776366.996109:0:5834:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789776366.996114:0:5834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789776366.996117:0:5834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776366.996118:0:5834:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789776366.996120:0:5834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789776366.996124:0:5834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776366.996125:0:5834:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1789776366.996128:0:5834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789776366.996134:0:5834:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000004bad2e77) 00000020:00000080:1.0:1789776366.996143:0:5834:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1789776366.996146:0:5834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789776366.996147:0:5834:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1789776366.996149:0:5834:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1789776366.996161:0:5834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789776366.996211:0:5834:0:(tgt_mount.c:153:server_get_mount()) get mount 000000007aa40aba from lustre-MDT0000, refs=3 00000020:00000080:1.0:1789776366.997992:0:5834:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000006931bbaa) 00000020:00000080:1.0:1789776366.998014:0:5834:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789776366.998089:0:5834:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789776366.998106:0:5834:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x26940258de8eedef 00000020:00000080:1.0:1789776366.999098:0:5834:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789776366.999109:0:5834:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789776366.999117:0:5834:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x26940258de8eedf6 00080000:01000000:1.0:1789776366.999125:0:5834:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789776366.999129:0:5834:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x26940258de8eedfd 00080000:10000000:1.0:1789776367.000007:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1789776367.000528:0:5834:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1789776367.004971:0:5834:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1789776367.112545:0:5834:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1789776367.112934:0:5834:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1789776367.116146:0:5834:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1789776367.116650:0:5834:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789776367.147857:0:5834:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000a1ef2a54) 00000020:00000080:3.0:1789776367.147890:0:5834:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789776367.147967:0:5834:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789776367.147977:0:5834:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x26940258de8eee0b 00000020:00000080:1.0:1789776367.152685:0:5834:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1789776367.156605:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789776367.207565:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789776367.261725:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789776367.290076:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789776367.366351:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789776367.426062:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1789776367.490332:0:5834:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x26940258de8eee12 00000020:00000080:3.0:1789776367.494779:0:5834:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789776367.495001:0:5834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789776367.495014:0:5834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776367.495016:0:5834:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789776367.495020:0:5834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789776367.495026:0:5834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776367.495027:0:5834:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789776367.495032:0:5834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789776367.495081:0:5834:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789776367.495099:0:5834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789776367.495102:0:5834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776367.495103:0:5834:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1789776367.495105:0:5834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789776367.495108:0:5834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776367.495109:0:5834:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789776367.495112:0:5834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789776367.495113:0:5834:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789776367.495405:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000039f90ee5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:5834:1876716471452928:0@lo:502: 00000100:00100000:3.0:1789776367.495492:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776367.495808:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 000000004eab0cad going to sleep for 11 seconds 00000100:00100000:2.0:1789776367.496040:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471452928 00000100:00100000:2.0:1789776367.496050:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471452928 00000100:00100000:2.0:1789776367.496161:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789776367.496170:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043011938 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+9:5834:x1876716471452928:12345-0@lo:502: 00000100:00100000:2.0:1789776367.497209:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043011938 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+9:5834:x1876716471452928:12345-0@lo:502: Request processed in 1036us (1714us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776367.497344:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000039f90ee5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:5834:1876716471452928:0@lo:502: 00000020:01000000:0.0:1789776367.497387:0:5834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789776367.497394:0:5834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776367.497395:0:5834:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789776367.497399:0:5834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1789776367.497727:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1789776367.497749:0:5791:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789776367.497771:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: 00000000f0ab960b/0x26940258de8eedc5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eedcc expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.497782:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: 00000000f0ab960b/0x26940258de8eedc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eedcc expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776367.497791:0:5791:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c86c01a7000 from 1 10000000:01000000:1.0:1789776367.497793:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789776367.497839:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: 00000000e1f4cb4f/0x26940258de8eee19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.497847:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: 00000000e1f4cb4f/0x26940258de8eee19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.497866:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: 00000000e1f4cb4f/0x26940258de8eee19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776367.497884:0:5791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009cdd0991 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:5791:1876716471453056:0@lo:101: 00000100:00100000:1.0:1789776367.497927:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776367.497983:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789776367.498778:0:5791:0:(client.c:2715:ptlrpc_set_wait()) set 0000000094d71d92 going to sleep for 11 seconds 00000100:00100000:3.0:1789776367.498867:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471453056 00000100:00100000:3.0:1789776367.498875:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471453056 00000100:00100000:3.0:1789776367.498918:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789776367.498926:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c9e51054 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+9:5791:x1876716471453056:12345-0@lo:101: 00010000:00010000:3.0:1789776367.498942:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776367.498957:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008127f373/0x26940258de8eee20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8eee19 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.499049:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008127f373/0x26940258de8eee20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8eee19 expref: 10 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.499057:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008127f373/0x26940258de8eee20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8eee19 expref: 10 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.499065:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008127f373, rc 0) 00000100:00100000:3.0:1789776367.499107:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c9e51054 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+10:5791:x1876716471453056:12345-0@lo:101: Request processed in 182us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776367.499113:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789776367.499381:0:5791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009cdd0991 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:5791:1876716471453056:0@lo:101: 00010000:00010000:1.0:1789776367.499397:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: 00000000e1f4cb4f/0x26940258de8eee19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eee20 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.499404:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: 00000000e1f4cb4f/0x26940258de8eee19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8eee20 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776367.500442:0:5791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009cdd0991 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:5791:1876716471453184:0@lo:256: 00000100:00100000:1.0:1789776367.500503:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776367.500588:0:5791:0:(client.c:2715:ptlrpc_set_wait()) set 0000000094d71d92 going to sleep for 11 seconds 00000100:00100000:0.0:1789776367.500743:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471453184 00000100:00100000:0.0:1789776367.500750:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471453184 00000100:00100000:0.0:1789776367.500920:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789776367.500929:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ce41d663 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+10:5791:x1876716471453184:12345-0@lo:256: 20000000:01000000:0.0:1789776367.500950:0:5806:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789776367.500956:0:5806:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1789776367.501031:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ce41d663 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+10:5791:x1876716471453184:12345-0@lo:256: Request processed in 104us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776367.501039:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789776367.501111:0:5791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009cdd0991 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:5791:1876716471453184:0@lo:256: 10000000:01000000:1.0:1789776367.502088:0:5791:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789776367.502122:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: 00000000e1f4cb4f/0x26940258de8eee19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eee20 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.502134:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: 00000000e1f4cb4f/0x26940258de8eee19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eee20 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776367.502143:0:5791:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c86c01a7000 from 1 10000000:01000000:1.0:1789776367.502146:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789776367.502186:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: 000000001c4da75f/0x26940258de8eee27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.502193:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: 000000001c4da75f/0x26940258de8eee27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.502202:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: 000000001c4da75f/0x26940258de8eee27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776367.502251:0:5791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009cdd0991 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:5791:1876716471453312:0@lo:101: 00000100:00100000:1.0:1789776367.502302:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776367.502841:0:5791:0:(client.c:2715:ptlrpc_set_wait()) set 0000000094d71d92 going to sleep for 11 seconds 00000100:00100000:2.0:1789776367.503027:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471453312 00000100:00100000:2.0:1789776367.503036:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471453312 00000100:00100000:2.0:1789776367.503081:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789776367.503089:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3ec8460 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+10:5791:x1876716471453312:12345-0@lo:101: 00010000:00010000:2.0:1789776367.503102:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776367.503120:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000108710d5/0x26940258de8eee2e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8eee27 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776367.503344:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000108710d5/0x26940258de8eee2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8eee27 expref: 11 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776367.503357:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000108710d5/0x26940258de8eee2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8eee27 expref: 11 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776367.503367:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000108710d5, rc 0) 00000100:00100000:2.0:1789776367.503478:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3ec8460 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+11:5791:x1876716471453312:12345-0@lo:101: Request processed in 390us (1176us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776367.503486:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789776367.503883:0:5791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009cdd0991 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:5791:1876716471453312:0@lo:101: 00010000:00010000:1.0:1789776367.503902:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: 000000001c4da75f/0x26940258de8eee27 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eee2e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.503912:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: 000000001c4da75f/0x26940258de8eee27 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8eee2e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776367.503971:0:5791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009cdd0991 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:5791:1876716471453440:0@lo:501: 00000100:00100000:1.0:1789776367.504006:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776367.504082:0:5791:0:(client.c:2715:ptlrpc_set_wait()) set 0000000094d71d92 going to sleep for 11 seconds 00000100:00100000:2.0:1789776367.504121:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471453440 00000100:00100000:2.0:1789776367.504126:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471453440 00000100:00100000:0.0:1789776367.504742:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789776367.504753:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eecb03fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+11:5791:x1876716471453440:12345-0@lo:501: 00000100:00100000:0.0:1789776367.505778:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eecb03fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+11:5791:x1876716471453440:12345-0@lo:501: Request processed in 1026us (1770us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776367.505787:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789776367.505972:0:5791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009cdd0991 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:5791:1876716471453440:0@lo:501: 00000100:00100000:2.0:1789776367.506019:0:5791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000880ce3d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:5791:1876716471453568:0@lo:503: 00000100:00100000:2.0:1789776367.506070:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776367.506529:0:5791:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e126b3de going to sleep for 11 seconds 00000100:00100000:0.0:1789776367.506582:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471453568 00000100:00100000:0.0:1789776367.506590:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471453568 00000100:00100000:0.0:1789776367.506636:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789776367.506652:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000197fd004 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+11:5791:x1876716471453568:12345-0@lo:503: 00000040:00080000:0.0:1789776367.506696:0:5804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789776367.506748:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000197fd004 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+11:5791:x1876716471453568:12345-0@lo:503: Request processed in 97us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776367.506755:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789776367.506959:0:5791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000880ce3d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:5791:1876716471453568:0@lo:503: 00000040:00080000:0.0:1789776367.513736:0:5838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1789776367.514906:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1789776367.514951:0:5791:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789776367.514977:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: 000000001c4da75f/0x26940258de8eee27 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eee2e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776367.514991:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: 000000001c4da75f/0x26940258de8eee27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eee2e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776367.515040:0:5791:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789776367.515043:0:5791:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c86c01a7000 10000000:01000000:2.0:1789776367.515046:0:5791:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c86c01a7000 10000000:01000000:2.0:1789776367.515051:0:5791:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789776367.515058:0:5791:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c86c01a7000 from 1 10000000:01000000:2.0:1789776367.515060:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789776367.515102:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: 0000000008606230/0x26940258de8eee35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776367.515111:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: 0000000008606230/0x26940258de8eee35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776367.515122:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: 0000000008606230/0x26940258de8eee35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776367.515147:0:5791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000880ce3d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:5791:1876716471453696:0@lo:101: 00000100:00100000:2.0:1789776367.515396:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776367.515451:0:5791:0:(client.c:2715:ptlrpc_set_wait()) set 0000000009b3e339 going to sleep for 11 seconds 00000100:00100000:0.0:1789776367.516364:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471453696 00000100:00100000:0.0:1789776367.516377:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471453696 00000100:00100000:0.0:1789776367.516440:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789776367.516463:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006c2f9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+11:5791:x1876716471453696:12345-0@lo:101: 00010000:00010000:0.0:1789776367.516480:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776367.516497:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f705fc74/0x26940258de8eee3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8eee35 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776367.516525:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f705fc74/0x26940258de8eee3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8eee35 expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776367.516536:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f705fc74/0x26940258de8eee3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8eee35 expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776367.516545:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f705fc74, rc 0) 00000100:00100000:0.0:1789776367.516760:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006c2f9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+12:5791:x1876716471453696:12345-0@lo:101: Request processed in 299us (1365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776367.516768:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789776367.516805:0:5791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000880ce3d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:5791:1876716471453696:0@lo:101: 00010000:00010000:3.0:1789776367.516834:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: 0000000008606230/0x26940258de8eee35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eee3c expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.516843:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: 0000000008606230/0x26940258de8eee35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8eee3c expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776367.516912:0:5791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001cabf934 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:5791:1876716471453824:0@lo:501: 00000100:00100000:3.0:1789776367.516949:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776367.516995:0:5791:0:(client.c:2715:ptlrpc_set_wait()) set 00000000161aa0b6 going to sleep for 11 seconds 00000100:00100000:2.0:1789776367.519782:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471453824 00000100:00100000:2.0:1789776367.519867:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471453824 00000100:00100000:2.0:1789776367.519934:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789776367.519943:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b10f562f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+12:5791:x1876716471453824:12345-0@lo:501: 00000100:00100000:2.0:1789776367.521504:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b10f562f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+12:5791:x1876716471453824:12345-0@lo:501: Request processed in 1556us (4548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776367.521532:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789776367.524555:0:5791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001cabf934 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:5791:1876716471453824:0@lo:501: 00000100:00100000:3.0:1789776367.524645:0:5791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001cabf934 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:5791:1876716471453952:0@lo:503: 00000100:00100000:3.0:1789776367.524861:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776367.524933:0:5791:0:(client.c:2715:ptlrpc_set_wait()) set 00000000161aa0b6 going to sleep for 11 seconds 00000100:00100000:1.0:1789776367.525039:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471453952 00000100:00100000:1.0:1789776367.525048:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471453952 00000100:00100000:1.0:1789776367.525106:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789776367.525117:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004883566c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+12:5791:x1876716471453952:12345-0@lo:503: 00000100:00100000:1.0:1789776367.525548:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004883566c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+12:5791:x1876716471453952:12345-0@lo:503: Request processed in 431us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776367.525557:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789776367.526642:0:5791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001cabf934 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:5791:1876716471453952:0@lo:503: 00010000:00010000:0.0:1789776367.528318:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776367.531060:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f9f93822 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:5839:1876716471454080:0@lo:502: 00000100:00100000:2.0:1789776367.531180:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776367.531269:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set 000000005f0e4c64 going to sleep for 11 seconds 00000100:00100000:3.0:1789776367.531894:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471454080 00000100:00100000:3.0:1789776367.531906:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471454080 00000100:00100000:3.0:1789776367.531998:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789776367.532009:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c568e915 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+12:5839:x1876716471454080:12345-0@lo:502: 00000100:00100000:3.0:1789776367.532390:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c568e915 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+12:5839:x1876716471454080:12345-0@lo:502: Request processed in 382us (1210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776367.532399:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789776367.532472:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f9f93822 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:5839:1876716471454080:0@lo:502: 00000020:01000004:2.0:1789776367.532544:0:5839:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789776367.532579:0:5839:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000004190b4ad) 00000020:00000080:2.0:1789776367.532680:0:5839:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1789776367.532872:0:5839:0:(tgt_mount.c:153:server_get_mount()) get mount 000000007aa40aba from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789776367.532878:0:5839:0:(tgt_mount.c:187:server_put_mount()) put mount 000000007aa40aba from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789776367.532880:0:5839:0:(obd_mount.c:710:lustre_put_lsi()) put 000000007aa40aba 4 00010000:00080000:2.0:1789776367.532914:0:5839:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000072034e8c@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.106@tcp at head 00010000:00010000:2.0:1789776367.537030:0:5839:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1789776367.537787:0:5839:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789776367.537955:0:5839:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789776367.537970:0:5839:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x26940258de8eee4a 00000100:00080000:2.0:1789776367.537984:0:5839:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789776367.537990:0:5839:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000072034e8c using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1789776367.538034:0:5839:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f9f93822 x1876716471454208/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789776367.538061:0:5839:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789776367.538198:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f9f93822 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3272:1876716471454208:0@lo:38: 00000100:00100000:1.0:1789776367.538306:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776367.539283:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471454208 00000100:00100000:0.0:1789776367.539294:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471454208 00000100:00100000:0.0:1789776367.539333:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789776367.539340:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b55e8e3d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3272:x1876716471454208:12345-0@lo:38: 00000100:00100000:0.0:1789776367.539421:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b55e8e3d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3272:x1876716471454208:12345-0@lo:38: Request processed in 79us (1115us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789776367.539428:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789776367.539476:0:3272:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789776367.539486:0:3272:0:(import.c:65:import_set_state_nolock()) 0000000072034e8c lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789776367.539489:0:3272:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789776367.539493:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f9f93822 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3272:1876716471454208:0@lo:38: 00000100:00100000:1.0:1789776367.541662:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003295264c pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:5839:1876716471454336:0@lo:502: 00000100:00100000:1.0:1789776367.541749:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776367.541788:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e23a0cb4 going to sleep for 11 seconds 00000100:00100000:2.0:1789776367.542193:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471454336 00000100:00100000:2.0:1789776367.542203:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471454336 00000100:00100000:2.0:1789776367.542475:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789776367.542484:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ea0647c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+12:5839:x1876716471454336:12345-0@lo:502: 00000100:00100000:2.0:1789776367.543092:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ea0647c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+12:5839:x1876716471454336:12345-0@lo:502: Request processed in 606us (1340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776367.543101:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789776367.556952:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003295264c pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:5839:1876716471454336:0@lo:502: 00000040:00080000:1.0:1789776367.557086:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1789776367.557630:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1789776367.557668:0:5791:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789776367.557688:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: 0000000008606230/0x26940258de8eee35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eee3c expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776367.557700:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: 0000000008606230/0x26940258de8eee35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eee3c expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789776367.557760:0:5791:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789776367.557763:0:5791:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789776367.557764:0:5791:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789776367.557766:0:5791:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789776367.557767:0:5791:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789776367.557769:0:5791:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789776367.557770:0:5791:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789776367.557772:0:5791:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789776367.557773:0:5791:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789776367.557775:0:5791:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789776367.557776:0:5791:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789776367.557777:0:5791:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789776367.557781:0:5791:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1789776367.557784:0:5791:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789776367.557785:0:5791:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789776367.557793:0:5791:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789776367.557794:0:5791:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789776367.557795:0:5791:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789776367.557796:0:5791:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789776367.557807:0:5791:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789776367.557808:0:5791:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789776367.557809:0:5791:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789776367.557810:0:5791:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789776367.557810:0:5791:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789776367.557811:0:5791:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789776367.557840:0:5791:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789776367.557860:0:5791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006a81ec27 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:5791:1876716471454464:0@lo:253: 00000100:00100000:0.0:1789776367.557928:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776367.557973:0:5791:0:(client.c:2715:ptlrpc_set_wait()) set 000000009352faf2 going to sleep for 11 seconds 00000100:00100000:0.0:1789776367.558479:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471454464 00000100:00100000:0.0:1789776367.558489:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471454464 00000100:00100000:0.0:1789776367.558547:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789776367.558556:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae7b1a5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+12:5791:x1876716471454464:12345-0@lo:253: 20000000:01000000:0.0:1789776367.558617:0:5805:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789776367.558631:0:5805:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789776367.593916:0:5805:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789776367.593938:0:5805:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1789776367.594384:0:5827:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789776367.594390:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789776367.594413:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008688fcc9/0x26940258de8eee51 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.594434:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008127f373/0x26940258de8eee20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8eee19 expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.594442:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000008688fcc9/0x26940258de8eee51 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.594489:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008127f373/0x26940258de8eee20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26940258de8eee19 expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776367.594507:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008127f373/0x26940258de8eee20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26940258de8eee19 expref: 12 pid: 5805 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776367.594523:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a3d15003 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5827:1876716471454592:0@lo:104: 00000100:00100000:3.0:1789776367.594613:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776367.594674:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 0000000026edf51a going to sleep for 11 seconds 00000100:00100000:1.0:1789776367.594740:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471454592 00000100:00100000:1.0:1789776367.594751:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471454592 00000100:00100000:1.0:1789776367.594819:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789776367.594828:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001011f117 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9db43398-240e-4f78-8778-c11d527e09a1+3:5827:x1876716471454592:12345-0@lo:104: 00010000:00010000:1.0:1789776367.594841:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: 00000000e1f4cb4f/0x26940258de8eee19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8eee20 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.594902:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789776367.594907:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001011f117 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9db43398-240e-4f78-8778-c11d527e09a1+3:5827:x1876716471454592:12345-0@lo:104: Request processed in 81us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776367.594915:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1789776367.594937:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776367.594944:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: 00000000e1f4cb4f/0x26940258de8eee19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8eee20 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.594951:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e1f4cb4f already unused, calling callback (000000000bb1e703) 10000000:00010000:1.0:1789776367.594954:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: 00000000e1f4cb4f/0x26940258de8eee19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26940258de8eee20 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.594961:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: 00000000e1f4cb4f/0x26940258de8eee19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26940258de8eee20 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789776367.594968:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: 00000000e1f4cb4f/0x26940258de8eee19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26940258de8eee20 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776367.594987:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789776367.595018:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: 00000000e1f4cb4f/0x26940258de8eee19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eee20 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.595024:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789776367.595040:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: 00000000e1f4cb4f/0x26940258de8eee19 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eee20 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.595047:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: 00000000e1f4cb4f/0x26940258de8eee19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eee20 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.595063:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776367.595064:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776367.595066:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776367.595123:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000076d98ea9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9db43398-240e-4f78-8778-c11d527e09a1:3274:1876716471454720:0@lo:103: 00000100:00100000:1.0:1789776367.595151:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776367.595214:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471454720 00000100:00100000:1.0:1789776367.595242:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471454720 00010000:00010000:1.0:1789776367.595259:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008127f373/0x26940258de8eee20 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8eee19 expref: 13 pid: 5805 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776367.595281:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789776367.595286:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087b8a4bd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9db43398-240e-4f78-8778-c11d527e09a1+13:3274:x1876716471454720:12345-0@lo:103: 00010000:00010000:1.0:1789776367.595296:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776367.595301:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008127f373/0x26940258de8eee20 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8eee19 expref: 13 pid: 5805 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.595310:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008127f373/0x26940258de8eee20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26940258de8eee19 expref: 13 pid: 5805 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.595332:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000008688fcc9/0x26940258de8eee51 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.595340:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008688fcc9/0x26940258de8eee51 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789776367.595353:0:5795:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000964057s 00010000:00010000:1.0:1789776367.595356:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008688fcc9/0x26940258de8eee51 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.595363:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008688fcc9/0x26940258de8eee51 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.595369:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008688fcc9/0x26940258de8eee51 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.595374:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008688fcc9/0x26940258de8eee51 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.595378:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008688fcc9 already unused, calling callback (00000000aa3fe46b) 00010000:00010000:1.0:1789776367.595382:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008688fcc9/0x26940258de8eee51 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.595389:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008688fcc9/0x26940258de8eee51 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.595397:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008688fcc9/0x26940258de8eee51 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.595407:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776367.595434:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087b8a4bd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9db43398-240e-4f78-8778-c11d527e09a1+13:3274:x1876716471454720:12345-0@lo:103: Request processed in 149us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776367.595445:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789776367.595487:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000076d98ea9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9db43398-240e-4f78-8778-c11d527e09a1:3274:1876716471454720:0@lo:103: 00010000:00010000:1.0:1789776367.595516:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008127f373/0x26940258de8eee20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26940258de8eee19 expref: 12 pid: 5805 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776367.595524:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a3d15003 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5827:1876716471454592:0@lo:104: 00010000:00010000:1.0:1789776367.595535:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000008688fcc9/0x26940258de8eee51 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.595544:0:5827:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000008688fcc9/0x26940258de8eee51 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.595549:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008688fcc9/0x26940258de8eee51 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776367.595554:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008688fcc9/0x26940258de8eee51 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776367.602121:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae7b1a5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+11:5791:x1876716471454464:12345-0@lo:253: Request processed in 43558us (44185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776367.602138:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789776367.602389:0:5791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006a81ec27 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:5791:1876716471454464:0@lo:253: 10000000:01000000:0.0:1789776367.602410:0:5791:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789776367.602413:0:5791:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789776367.602415:0:5791:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789776367.602417:0:5791:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789776367.602418:0:5791:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789776367.602419:0:5791:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789776367.602420:0:5791:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789776367.602421:0:5791:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789776367.602423:0:5791:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789776367.602424:0:5791:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789776367.602425:0:5791:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789776367.602427:0:5791:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789776367.602443:0:5791:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789776367.602459:0:5791:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789776367.610319:0:5791:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1789776367.610924:0:5791:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789776367.611143:0:5791:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1789776367.611491:0:5791:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789776367.613476:0:5791:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1789776367.614072:0:5791:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1789776367.615010:0:5791:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1789776367.615190:0:5791:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1789776367.616207:0:5791:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1789776367.616698:0:5791:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1789776367.617041:0:5791:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1789776367.617966:0:5791:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1789776367.720584:0:5791:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1789776367.814726:0:5791:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1789776367.815178:0:5845:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:2.0:1789776367.823114:0:5844:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1789776367.823122:0:5844:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1789776367.832161:0:5791:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1789776367.832922:0:5791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789776367.833735:0:5791:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789776367.833747:0:5791:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1789776367.834087:0:5791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789776367.835366:0:5791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789776367.836111:0:5791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789776367.836164:0:5791:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1789776367.837018:0:5791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1789776367.837286:0:5791:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1789776367.838763:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1789776367.839209:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1789776367.840051:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1789776367.840205:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1789776367.841018:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1789776367.841160:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1789776367.841415:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1789776367.841561:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1789776367.843351:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1789776367.843550:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1789776367.843738:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1789776367.844407:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1789776367.844588:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1789776367.844793:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1789776367.845115:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1789776367.845370:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1789776367.845914:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1789776367.846049:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1789776367.846203:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1789776367.846388:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1789776367.846535:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1789776367.847026:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1789776367.847200:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1789776367.847906:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1789776367.848087:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1789776367.848320:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1789776367.848464:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1789776367.848928:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1789776367.849097:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1789776367.849988:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1789776367.850918:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1789776367.851724:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1789776367.851998:0:5791:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1789776367.873756:0:5845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1789776367.936410:0:5791:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789776367.936453:0:5791:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb98c41847988 00100000:10000000:3.0:1789776367.936461:0:5791:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1789776367.939278:0:5791:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789776367.939297:0:5791:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.106@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789776367.939312:0:5791:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1789776367.939332:0:5791:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1789776368.018787:0:5845:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789776368.019408:0:5845:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:1.0:1789776368.019413:0:5845:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1789776368.537512:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776369.556521:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776370.580398:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776371.604391:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789776372.630576:0:5808:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789776372.630583:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c86c01a7000 from 3 10000000:01000000:0.0:1789776372.630587:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789776372.630627:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: 00000000a19dfbaa/0x26940258de8eee58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776372.630639:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: 00000000a19dfbaa/0x26940258de8eee58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776372.630648:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: 00000000a19dfbaa/0x26940258de8eee58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776372.630668:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006a81ec27 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471454848:0@lo:101: 00000100:00100000:0.0:1789776372.630729:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776372.630774:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set 000000005e0a5588 going to sleep for 11 seconds 00000100:00100000:0.0:1789776372.630795:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471454848 00000100:00100000:0.0:1789776372.630802:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471454848 00000100:00100000:0.0:1789776372.630845:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789776372.630852:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000053f8f9ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+11:5808:x1876716471454848:12345-0@lo:101: 00010000:00010000:0.0:1789776372.630866:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776372.630878:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a78eb8bf/0x26940258de8eee5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8eee58 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776372.630900:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a78eb8bf/0x26940258de8eee5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8eee58 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776372.630910:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a78eb8bf/0x26940258de8eee5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8eee58 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776372.630927:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a78eb8bf, rc 0) 00000100:00100000:0.0:1789776372.630965:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000053f8f9ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+12:5808:x1876716471454848:12345-0@lo:101: Request processed in 113us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776372.630971:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789776372.631017:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006a81ec27 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471454848:0@lo:101: 00010000:00010000:0.0:1789776372.631031:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: 00000000a19dfbaa/0x26940258de8eee58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eee5f expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776372.631038:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: 00000000a19dfbaa/0x26940258de8eee58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8eee5f expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776372.631083:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006a81ec27 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471454976:0@lo:256: 00000100:00100000:0.0:1789776372.631115:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776372.631129:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set 000000005e0a5588 going to sleep for 11 seconds 00000100:00100000:0.0:1789776372.631141:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471454976 00000100:00100000:0.0:1789776372.631144:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471454976 00000100:00100000:0.0:1789776372.631165:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789776372.631171:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ba2e160 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+12:5808:x1876716471454976:12345-0@lo:256: 20000000:01000000:0.0:1789776372.631185:0:5805:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789776372.631200:0:5805:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789776372.631203:0:5805:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1789776372.631293:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ba2e160 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+12:5808:x1876716471454976:12345-0@lo:256: Request processed in 122us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776372.631300:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789776372.631327:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006a81ec27 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471454976:0@lo:256: 10000000:01000000:0.0:1789776372.631365:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789776372.631374:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: 00000000a19dfbaa/0x26940258de8eee58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eee5f expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776372.631381:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: 00000000a19dfbaa/0x26940258de8eee58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eee5f expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776372.631535:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789776372.632608:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789776372.632615:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789776372.632618:0:36:0:(import.c:65:import_set_state_nolock()) 0000000072034e8c lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789776372.632627:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000072034e8c using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1789776372.632655:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006172d3b9 x1876716471455104/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789776372.632712:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006172d3b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3272:1876716471455104:0@lo:38: 00000100:00100000:0.0:1789776372.632813:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776372.635755:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471455104 00000100:00100000:2.0:1789776372.635769:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471455104 00000100:00100000:2.0:1789776372.635818:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789776372.635825:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a81ec27 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3272:x1876716471455104:12345-0@lo:38: 00010000:00080000:2.0:1789776372.635853:0:5813:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 125 last 0 00000020:00000080:2.0:1789776372.635888:0:5813:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x26940258de8eee66 00000004:00100000:2.0:1789776372.635934:0:5813:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789776372.636082:0:5813:0:(import.c:65:import_set_state_nolock()) 00000000152c290c : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789776372.637721:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a81ec27 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3272:x1876716471455104:12345-0@lo:38: Request processed in 1889us (4903us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776372.637739:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789776372.639942:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000006172d3b9 x1876716471455104/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789776382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789776372.639966:0:3272:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789776372.639974:0:3272:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789776372.639979:0:3272:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789776372.639982:0:3272:0:(import.c:65:import_set_state_nolock()) 0000000072034e8c lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789776372.639988:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006172d3b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3272:1876716471455104:0@lo:38: 00000001:02000400:3.0:1789776372.878117:0:6087:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789776373.656731:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776374.677184:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776375.700379:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776376.724424:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789776377.604009:0:6289:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe3a5f81f0 20000000:00000080:0.0:1789776377.604028:0:6289:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c86af471000 uarg=0000000000000000 20000000:01000000:0.0:1789776377.604058:0:6289:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1789776377.604064:0:6289:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1789776377.604069:0:6289:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1789776377.604845:0:6289:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1789776377.604856:0:6289:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1789776377.612838:0:6289:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789776377.613107:0:6289:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789776377.613551:0:6289:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1789776377.613608:0:6289:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1789776377.613638:0:6289:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789776377.613664:0:6289:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e557796f/0x26940258de8eee6d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776377.613692:0:6289:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000108710d5/0x26940258de8eee2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8eee27 expref: 11 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776377.613699:0:6289:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000e557796f/0x26940258de8eee6d lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776377.613739:0:6289:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000108710d5/0x26940258de8eee2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26940258de8eee27 expref: 11 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776377.613754:0:6289:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000108710d5/0x26940258de8eee2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26940258de8eee27 expref: 11 pid: 5804 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776377.613769:0:6289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a30767f0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6289:1876716471455232:0@lo:104: 00000100:00100000:0.0:1789776377.613835:0:6289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776377.613887:0:6289:0:(client.c:2715:ptlrpc_set_wait()) set 000000009ddf3d73 going to sleep for 11 seconds 00000100:00100000:3.0:1789776377.614006:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471455232 00000100:00100000:3.0:1789776377.614015:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471455232 00000100:00100000:3.0:1789776377.614069:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789776377.614077:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000066531463 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9db43398-240e-4f78-8778-c11d527e09a1+3:6289:x1876716471455232:12345-0@lo:104: 00010000:00010000:3.0:1789776377.614089:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: 000000001c4da75f/0x26940258de8eee27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8eee2e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776377.614157:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789776377.614162:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000066531463 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9db43398-240e-4f78-8778-c11d527e09a1+3:6289:x1876716471455232:12345-0@lo:104: Request processed in 87us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776377.614169:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1789776377.614264:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776377.614270:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: 000000001c4da75f/0x26940258de8eee27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8eee2e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776377.614278:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001c4da75f already unused, calling callback (000000000bb1e703) 10000000:00010000:1.0:1789776377.614281:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: 000000001c4da75f/0x26940258de8eee27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26940258de8eee2e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776377.614299:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: 000000001c4da75f/0x26940258de8eee27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26940258de8eee2e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789776377.614305:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: 000000001c4da75f/0x26940258de8eee27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26940258de8eee2e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776377.614311:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789776377.614343:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: 000000001c4da75f/0x26940258de8eee27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eee2e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776377.614349:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789776377.614367:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: 000000001c4da75f/0x26940258de8eee27 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eee2e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776377.614373:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: 000000001c4da75f/0x26940258de8eee27 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eee2e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776377.614391:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776377.614393:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776377.614394:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776377.614456:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000076d98ea9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471455360:0@lo:103: 00000100:00100000:1.0:1789776377.614511:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776377.614631:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471455360 00000100:00100000:1.0:1789776377.614636:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471455360 00010000:00010000:1.0:1789776377.614654:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000108710d5/0x26940258de8eee2e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8eee27 expref: 12 pid: 5804 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776377.614686:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789776377.614692:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ecd06ab0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9db43398-240e-4f78-8778-c11d527e09a1+12:3275:x1876716471455360:12345-0@lo:103: 00010000:00010000:1.0:1789776377.614709:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776377.614715:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000108710d5/0x26940258de8eee2e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8eee27 expref: 12 pid: 5804 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776377.614724:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000108710d5/0x26940258de8eee2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26940258de8eee27 expref: 12 pid: 5804 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776377.614740:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000e557796f/0x26940258de8eee6d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776377.614749:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e557796f/0x26940258de8eee6d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776377.614760:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e557796f/0x26940258de8eee6d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776377.614767:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e557796f/0x26940258de8eee6d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776377.614772:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e557796f/0x26940258de8eee6d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776377.614778:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e557796f/0x26940258de8eee6d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776377.614784:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e557796f already unused, calling callback (00000000aa3fe46b) 00010000:00010000:1.0:1789776377.614787:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e557796f/0x26940258de8eee6d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776377.614793:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e557796f/0x26940258de8eee6d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776377.614809:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e557796f/0x26940258de8eee6d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776377.614820:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776377.614847:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ecd06ab0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9db43398-240e-4f78-8778-c11d527e09a1+12:3275:x1876716471455360:12345-0@lo:103: Request processed in 156us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776377.614854:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789776377.614888:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000076d98ea9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471455360:0@lo:103: 00010000:00010000:0.0:1789776377.615555:0:6289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000108710d5/0x26940258de8eee2e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26940258de8eee27 expref: 11 pid: 5804 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776377.615568:0:6289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a30767f0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6289:1876716471455232:0@lo:104: 00010000:00010000:0.0:1789776377.615583:0:6289:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000e557796f/0x26940258de8eee6d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776377.615592:0:6289:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000e557796f/0x26940258de8eee6d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776377.615596:0:6289:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e557796f/0x26940258de8eee6d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776377.615601:0:6289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e557796f/0x26940258de8eee6d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776377.748871:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789776377.748899:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000076d98ea9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3275:1876716471455488:0@lo:400: 00000100:00100000:1.0:1789776377.749038:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789776377.749101:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776377.749122:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471455488 00000100:00100000:1.0:1789776377.749130:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471455488 00000100:00100000:1.0:1789776377.749182:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789776377.749190:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002b05ca96 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1876716471455488:12345-0@lo:400: 00000100:00100000:1.0:1789776377.749772:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002b05ca96 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1876716471455488:12345-0@lo:400: Request processed in 580us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776377.749781:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789776377.749824:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000076d98ea9 x1876716471455488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776377.749838:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000076d98ea9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3275:1876716471455488:0@lo:400: 00010000:00010000:1.0:1789776378.772658:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789776378.971241:0:5808:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789776378.971250:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c86c01a7000 from 1 10000000:01000000:0.0:1789776378.971254:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789776378.971296:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: 00000000e557796f/0x26940258de8eee74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776378.971308:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: 00000000e557796f/0x26940258de8eee74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776378.971317:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: 00000000e557796f/0x26940258de8eee74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776378.971338:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a30767f0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471455616:0@lo:101: 00000100:00100000:0.0:1789776378.971399:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776378.971450:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set 0000000009b0e80e going to sleep for 11 seconds 00000100:00100000:3.0:1789776378.971515:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471455616 00000100:00100000:3.0:1789776378.971523:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471455616 00000100:00100000:3.0:1789776378.971575:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789776378.971585:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004fc30040 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+11:5808:x1876716471455616:12345-0@lo:101: 00010000:00010000:3.0:1789776378.971598:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776378.971611:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008688fcc9/0x26940258de8eee7b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8eee74 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776378.971647:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008688fcc9/0x26940258de8eee7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8eee74 expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776378.971657:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008688fcc9/0x26940258de8eee7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8eee74 expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776378.971665:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008688fcc9, rc 0) 00000100:00100000:3.0:1789776378.971705:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004fc30040 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+12:5808:x1876716471455616:12345-0@lo:101: Request processed in 121us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776378.971712:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789776378.971786:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a30767f0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471455616:0@lo:101: 00010000:00010000:0.0:1789776378.971800:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: 00000000e557796f/0x26940258de8eee74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eee7b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776378.971807:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: 00000000e557796f/0x26940258de8eee74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8eee7b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776378.971856:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a30767f0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471455744:0@lo:501: 00000100:00100000:0.0:1789776378.971880:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776378.971902:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set 0000000009b0e80e going to sleep for 11 seconds 00000100:00100000:3.0:1789776378.972361:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471455744 00000100:00100000:3.0:1789776378.972366:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471455744 00000100:00100000:3.0:1789776378.972396:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789776378.972402:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b63c8422 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+12:5808:x1876716471455744:12345-0@lo:501: 00000100:00100000:3.0:1789776378.972644:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b63c8422 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+12:5808:x1876716471455744:12345-0@lo:501: Request processed in 242us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776378.972650:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789776378.972733:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a30767f0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471455744:0@lo:501: 00000100:00100000:2.0:1789776378.972764:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006971bed7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471455872:0@lo:503: 00000100:00100000:2.0:1789776378.972801:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776378.972830:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set 00000000df960030 going to sleep for 11 seconds 00000100:00100000:0.0:1789776378.972869:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471455872 00000100:00100000:0.0:1789776378.972873:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471455872 00000100:00100000:0.0:1789776378.972900:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789776378.972913:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055c0921e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+12:5808:x1876716471455872:12345-0@lo:503: 00000100:00100000:0.0:1789776378.973122:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055c0921e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+12:5808:x1876716471455872:12345-0@lo:503: Request processed in 210us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776378.973191:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789776378.974289:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006971bed7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471455872:0@lo:503: 00000100:00100000:2.0:1789776378.975239:0:6351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006971bed7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:6351:1876716471456000:0@lo:502: 00000100:00100000:2.0:1789776378.975296:0:6351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776378.975331:0:6351:0:(client.c:2715:ptlrpc_set_wait()) set 0000000004e16155 going to sleep for 11 seconds 00000100:00100000:3.0:1789776378.975388:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471456000 00000100:00100000:3.0:1789776378.975395:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471456000 00000100:00100000:3.0:1789776378.975439:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789776378.975448:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000030080b8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+12:6351:x1876716471456000:12345-0@lo:502: 00000100:00100000:3.0:1789776378.975654:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000030080b8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+12:6351:x1876716471456000:12345-0@lo:502: Request processed in 207us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776378.975662:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789776378.975742:0:6351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006971bed7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:6351:1876716471456000:0@lo:502: 00000020:01000000:2.0:1789776378.975765:0:6351:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789776378.975774:0:6351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776378.975777:0:6351:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789776378.975785:0:6351:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c86c01a7000 00000020:00000080:2.0:1789776378.975787:0:6351:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789776378.975830:0:6351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:6351:1876716471456128:0@lo:502: 00000100:00100000:2.0:1789776378.975864:0:6351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776378.975883:0:6351:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c869150eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789776378.976237:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471456128 00000100:00100000:3.0:1789776378.976242:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471456128 00000100:00100000:3.0:1789776378.976272:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789776378.976285:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+12:6351:x1876716471456128:12345-0@lo:502: 00000100:00100000:3.0:1789776378.976409:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+12:6351:x1876716471456128:12345-0@lo:502: Request processed in 124us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776378.976415:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789776378.976528:0:6351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:6351:1876716471456128:0@lo:502: 00000020:01000000:2.0:1789776378.976547:0:6351:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789776378.976551:0:6351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776378.976553:0:6351:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789776378.976556:0:6351:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1789776378.978274:0:5808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789776378.978311:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789776378.978323:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8680030200/0x26940258de8eee74 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eee7b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776378.978336:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c8680030200/0x26940258de8eee74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eee7b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776379.797358:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776380.820350:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776381.847740:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776382.868488:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776382.868568:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa654700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3274:1876716471456384:0@lo:400: 00000100:00100000:3.0:1789776382.868706:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776382.868718:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa655500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9db43398-240e-4f78-8778-c11d527e09a1:3273:1876716471456256:0@lo:400: 00000100:00100000:2.0:1789776382.868754:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776382.868808:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471456256 00000100:00100000:2.0:1789776382.868822:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471456256 00000100:00100000:2.0:1789776382.868871:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789776382.868881:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa595450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+12:3273:x1876716471456256:12345-0@lo:400: 00000100:00100000:1.0:1789776382.868925:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471456384 00000100:00100000:1.0:1789776382.868929:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471456384 00000100:00100000:2.0:1789776382.868937:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa595450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+12:3273:x1876716471456256:12345-0@lo:400: Request processed in 58us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776382.868945:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789776382.868956:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789776382.868962:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1876716471456384:12345-0@lo:400: 00000100:00100000:1.0:1789776382.869012:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1876716471456384:12345-0@lo:400: Request processed in 50us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776382.869018:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789776382.869088:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa655500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9db43398-240e-4f78-8778-c11d527e09a1:3273:1876716471456256:0@lo:400: 00010000:00080000:2.0:1789776382.869714:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c86aa654700 x1876716471456384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776382.869727:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa654700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3274:1876716471456384:0@lo:400: 00010000:00010000:2.0:1789776383.894414:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789776384.141963:0:6657:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789776384.141968:0:6657:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1789776384.142512:0:6657:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c86903b8800 00000020:01000004:3.0:1789776384.142531:0:6657:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789776384.142543:0:6657:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789776384.142559:0:6657:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9c86aa418000) 00000020:00000080:3.0:1789776384.142576:0:6657:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789776384.159833:0:6657:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1789776384.162345:0:6657:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1789776384.182384:0:6657:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789776384.187407:0:6657:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789776384.187456:0:6657:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789776384.187519:0:6657:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789776384.187560:0:6657:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789776384.187915:0:6657:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789776384.187926:0:6657:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789776384.187938:0:6657:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x26940258de8eee89 00000020:01000004:3.0:1789776384.187947:0:6657:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1789776384.187970:0:6657:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.106@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789776384.187974:0:6657:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789776384.187981:0:6657:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789776384.187986:0:6657:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789776384.188010:0:6657:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9c86b9904d28) 00000020:00000080:3.0:1789776384.188023:0:6657:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1789776384.189618:0:6657:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789776384.189857:0:6657:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789776384.189865:0:6657:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789776384.199366:0:6657:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789776384.199410:0:6657:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789776384.201025:0:6657:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789776384.201038:0:6657:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789776384.202824:0:6657:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789776384.203026:0:6657:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789776384.203030:0:6657:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789776384.203695:0:6657:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789776384.203703:0:6657:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789776384.228636:0:6657:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789776384.228940:0:6657:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789776384.228959:0:6657:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1789776384.232919:0:6657:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789776384.232932:0:6657:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1789776384.233593:0:6657:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789776384.233599:0:6657:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1789776384.237758:0:6657:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789776384.237965:0:6657:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789776384.237969:0:6657:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1789776384.238974:0:6657:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1789776384.238983:0:6657:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789776384.279517:0:6657:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789776384.279824:0:6657:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789776384.279832:0:6657:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789776384.280975:0:6657:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789776384.280985:0:6657:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789776384.281641:0:6657:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789776384.281674:0:6657:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1789776384.281682:0:6657:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.106@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789776384.301210:0:6657:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.106@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789776384.301441:0:6657:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.106@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1789776384.301447:0:6657:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789776384.301449:0:6657:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789776384.301450:0:6657:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789776384.301452:0:6657:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789776384.301453:0:6657:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789776384.301454:0:6657:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789776384.301456:0:6657:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789776384.301457:0:6657:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789776384.301459:0:6657:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789776384.301460:0:6657:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789776384.301462:0:6657:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789776384.301466:0:6657:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1789776384.301468:0:6657:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789776384.301470:0:6657:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789776384.301471:0:6657:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789776384.301472:0:6657:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789776384.301473:0:6657:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789776384.301474:0:6657:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789776384.301475:0:6657:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789776384.301477:0:6657:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789776384.301478:0:6657:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789776384.301479:0:6657:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789776384.301480:0:6657:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789776384.301522:0:6657:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789776384.301546:0:6657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:6657:1876716471456512:0@lo:253: 00000100:00100000:2.0:1789776384.301705:0:6657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776384.301825:0:6657:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86878f0600 going to sleep for 11 seconds 00000100:00100000:3.0:1789776384.301917:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471456512 00000100:00100000:3.0:1789776384.301925:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471456512 00000100:00100000:3.0:1789776384.302030:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789776384.302041:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa597050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+12:6657:x1876716471456512:12345-0@lo:253: 20000000:01000000:3.0:1789776384.302077:0:5805:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789776384.302083:0:5805:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1789776384.302090:0:5805:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1789776384.302096:0:5805:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1789776384.303523:0:5805:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789776384.303740:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1789776384.303755:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1789776384.303790:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1789776384.303797:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1789776384.303831:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1789776384.303883:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1789776384.304606:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1789776384.304754:0:5805:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.106@tcp 20000000:01000000:3.0:1789776384.304756:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.106@tcp (null) (null) (null) 00000040:00080000:3.0:1789776384.304794:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1789776384.304803:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789776384.304854:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1789776384.304863:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.106@tcp (null) (null) 00000040:00080000:3.0:1789776384.304899:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1789776384.304908:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789776384.304943:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1789776384.304998:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1789776384.305895:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1789776384.305915:0:5805:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.106@tcp 20000000:01000000:3.0:1789776384.305917:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.106@tcp (null) (null) (null) 00000040:00080000:3.0:1789776384.305950:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1789776384.305957:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789776384.305987:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1789776384.305993:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.106@tcp (null) (null) 00000040:00080000:3.0:1789776384.306037:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1789776384.306045:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789776384.306077:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1789776384.306212:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1789776384.306257:0:5805:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789776384.306260:0:5805:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789776384.306263:0:5805:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789776384.306275:0:5805:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789776384.306278:0:5805:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789776384.306312:0:5805:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789776384.306315:0:5805:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789776384.306920:0:6672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1789776384.307560:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1789776384.307681:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1789776384.307775:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1789776384.307789:0:5805:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789776384.307792:0:5805:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789776384.308898:0:6673:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1789776384.308963:0:6673:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1789776384.309016:0:6673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1789776384.309547:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1789776384.309593:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1789776384.309741:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1789776384.309757:0:5805:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789776384.309760:0:5805:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789776384.310394:0:6674:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:0.0:1789776384.310460:0:6674:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:0.0:1789776384.310513:0:6674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1789776384.310881:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1789776384.310922:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1789776384.310956:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1789776384.310970:0:5805:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1789776384.310972:0:5805:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1789776384.310983:0:5805:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789776384.311004:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c8681678600/0x26940258de8eee97 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776384.311023:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c86829e0a00/0x26940258de8eedb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8eeda9 expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776384.311032:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c86829e1800/0x26940258de8eedcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8eedc5 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776384.311038:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c8680031400/0x26940258de8eee3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8eee35 expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776384.311046:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c8681678600/0x26940258de8eee97 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776384.311087:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c8680031400/0x26940258de8eee3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26940258de8eee35 expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776384.311200:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c8680031400/0x26940258de8eee3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26940258de8eee35 expref: 12 pid: 5804 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776384.311423:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb4f0380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5805:1876716471456640:0@lo:104: 00000100:00100000:3.0:1789776384.311506:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789776384.311609:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c86829e1800/0x26940258de8eedcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26940258de8eedc5 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776384.311629:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c86829e1800/0x26940258de8eedcc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26940258de8eedc5 expref: 12 pid: 5806 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776384.311638:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb4f2680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5805:1876716471456768:0@lo:104: 00000100:00100000:3.0:1789776384.311678:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789776384.311863:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c86829e0a00/0x26940258de8eedb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26940258de8eeda9 expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776384.311871:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c86829e0a00/0x26940258de8eedb0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26940258de8eeda9 expref: 12 pid: 5804 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776384.311879:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb4f3b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5805:1876716471456896:0@lo:104: 00000100:00100000:3.0:1789776384.311902:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776384.311920:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471456640 00000100:00100000:1.0:1789776384.311927:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471456640 00000100:00100000:2.0:1789776384.311985:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471456768 00000100:00100000:2.0:1789776384.311989:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471456768 00000100:00100000:2.0:1789776384.312016:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789776384.312026:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9db43398-240e-4f78-8778-c11d527e09a1+4:5805:x1876716471456640:12345-0@lo:104: 00010000:00010000:2.0:1789776384.312041:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c868afc6000/0x26940258de8eee35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8eee3c expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.312100:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789776384.312112:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9db43398-240e-4f78-8778-c11d527e09a1+4:5805:x1876716471456640:12345-0@lo:104: Request processed in 87us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776384.312128:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789776384.312149:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789776384.312156:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9db43398-240e-4f78-8778-c11d527e09a1+3:5805:x1876716471456768:12345-0@lo:104: 00010000:00010000:2.0:1789776384.312163:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c868afc7a00/0x26940258de8eedc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8eedcc expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.312196:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789776384.312201:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9db43398-240e-4f78-8778-c11d527e09a1+3:5805:x1876716471456768:12345-0@lo:104: Request processed in 47us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776384.312206:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789776384.312256:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789776384.312262:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c868afc6000/0x26940258de8eee35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8eee3c expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.312268:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc6000 already unused, calling callback (ffffffffc1da0c20) 10000000:00010000:2.0:1789776384.312272:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c868afc6000/0x26940258de8eee35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x26940258de8eee3c expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.312280:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c868afc6000/0x26940258de8eee35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x26940258de8eee3c expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776384.312287:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c868afc6000/0x26940258de8eee35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x26940258de8eee3c expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776384.312294:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789776384.312326:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c868afc6000/0x26940258de8eee35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eee3c expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.312343:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789776384.312367:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c868afc6000/0x26940258de8eee35 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eee3c expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.312373:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c868afc6000/0x26940258de8eee35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eee3c expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.312386:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776384.312389:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c868afc7a00/0x26940258de8eedc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8eedcc expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.312395:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc7a00 already unused, calling callback (ffffffffc1da0c20) 10000000:00010000:2.0:1789776384.312398:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c868afc7a00/0x26940258de8eedc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x26940258de8eedcc expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.312404:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c868afc7a00/0x26940258de8eedc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x26940258de8eedcc expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776384.312410:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c868afc7a00/0x26940258de8eedc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x26940258de8eedcc expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776384.312415:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789776384.312426:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c868afc7a00/0x26940258de8eedc5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eedcc expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.312444:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789776384.312449:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c868afc7a00/0x26940258de8eedc5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eedcc expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.312455:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c868afc7a00/0x26940258de8eedc5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eedcc expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.312470:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776384.312472:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776384.312473:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776384.312487:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9db43398-240e-4f78-8778-c11d527e09a1:3276:1876716471457152:0@lo:103: 00000100:00100000:2.0:1789776384.312525:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776384.312553:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789776384.312558:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9db43398-240e-4f78-8778-c11d527e09a1:3276:1876716471457024:0@lo:103: 00000100:00100000:2.0:1789776384.312575:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789776384.312808:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776384.312911:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8682e95300 going to sleep for 11 seconds 00000100:00100000:3.0:1789776384.312929:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb4f0380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5805:1876716471456640:0@lo:104: 00000100:00100000:3.0:1789776384.312937:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb4f2680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5805:1876716471456768:0@lo:104: 00000100:00100000:2.0:1789776384.312993:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471456896 00000100:00100000:2.0:1789776384.312998:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471456896 00000100:00100000:2.0:1789776384.313018:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789776384.313024:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9db43398-240e-4f78-8778-c11d527e09a1+3:5805:x1876716471456896:12345-0@lo:104: 00010000:00010000:2.0:1789776384.313032:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c8680030400/0x26940258de8eeda9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8eedb0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.313077:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789776384.313083:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9db43398-240e-4f78-8778-c11d527e09a1+3:5805:x1876716471456896:12345-0@lo:104: Request processed in 59us (1180us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776384.313088:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1789776384.313101:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776384.313105:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c8680030400/0x26940258de8eeda9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8eedb0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.313110:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8680030400 already unused, calling callback (ffffffffc1da0c20) 10000000:00010000:2.0:1789776384.313114:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c8680030400/0x26940258de8eeda9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26940258de8eedb0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.313140:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c8680030400/0x26940258de8eeda9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26940258de8eedb0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776384.313146:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c8680030400/0x26940258de8eeda9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26940258de8eedb0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776384.313151:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789776384.313168:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c8680030400/0x26940258de8eeda9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eedb0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.313174:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789776384.313187:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c8680030400/0x26940258de8eeda9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eedb0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.313193:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c8680030400/0x26940258de8eeda9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eedb0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.313207:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776384.313209:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776384.313210:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776384.313236:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789776384.313245:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9db43398-240e-4f78-8778-c11d527e09a1:3274:1876716471457280:0@lo:103: 00000100:00100000:2.0:1789776384.313272:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776384.313413:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb4f3b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5805:1876716471456896:0@lo:104: 00010000:00010000:3.0:1789776384.313456:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c8681678600/0x26940258de8eee97 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776384.313575:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471457152 00000100:00100000:1.0:1789776384.313579:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471457152 00010000:00010000:1.0:1789776384.313598:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c86829e1800/0x26940258de8eedcc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8eedc5 expref: 13 pid: 5806 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776384.313612:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471457024 00000100:00100000:1.0:1789776384.313615:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471457024 00010000:00010000:1.0:1789776384.313696:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c8680031400/0x26940258de8eee3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8eee35 expref: 14 pid: 5804 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776384.313708:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471457280 00000100:00100000:1.0:1789776384.313711:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471457280 00010000:00010000:1.0:1789776384.313721:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c86829e0a00/0x26940258de8eedb0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8eeda9 expref: 15 pid: 5804 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776384.313733:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789776384.313738:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9db43398-240e-4f78-8778-c11d527e09a1+15:3276:x1876716471457152:12345-0@lo:103: 00010000:00010000:1.0:1789776384.313751:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776384.313756:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c86829e1800/0x26940258de8eedcc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8eedc5 expref: 15 pid: 5806 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776384.313772:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c86829e1800/0x26940258de8eedcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26940258de8eedc5 expref: 15 pid: 5806 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776384.313786:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c86829e1800/0x26940258de8eedcc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26940258de8eedc5 expref: 15 pid: 5806 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776384.313799:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776384.313914:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9db43398-240e-4f78-8778-c11d527e09a1+14:3276:x1876716471457152:12345-0@lo:103: Request processed in 176us (1389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776384.313921:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789776384.313935:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789776384.313941:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9db43398-240e-4f78-8778-c11d527e09a1+13:3276:x1876716471457024:12345-0@lo:103: 00010000:00010000:1.0:1789776384.313948:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776384.313953:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c8680031400/0x26940258de8eee3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8eee35 expref: 13 pid: 5804 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776384.313961:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c8680031400/0x26940258de8eee3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26940258de8eee35 expref: 13 pid: 5804 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776384.313970:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c8680031400/0x26940258de8eee3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26940258de8eee35 expref: 13 pid: 5804 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776384.313979:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776384.314001:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9db43398-240e-4f78-8778-c11d527e09a1+12:3276:x1876716471457024:12345-0@lo:103: Request processed in 61us (1424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776384.314006:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789776384.314018:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789776384.314023:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9db43398-240e-4f78-8778-c11d527e09a1+11:3274:x1876716471457280:12345-0@lo:103: 00010000:00010000:1.0:1789776384.314037:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776384.314041:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c86829e0a00/0x26940258de8eedb0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8eeda9 expref: 11 pid: 5804 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776384.314050:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c86829e0a00/0x26940258de8eedb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26940258de8eeda9 expref: 11 pid: 5804 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776384.314059:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c86829e0a00/0x26940258de8eedb0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26940258de8eeda9 expref: 11 pid: 5804 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776384.314071:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c8681678600/0x26940258de8eee97 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776384.314079:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c8681678600/0x26940258de8eee97 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776384.314093:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c8681678600/0x26940258de8eee97 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776384.314101:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c8681678600/0x26940258de8eee97 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776384.314108:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c8681678600/0x26940258de8eee97 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776384.314114:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c8681678600/0x26940258de8eee97 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776384.314134:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681678600 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:1.0:1789776384.314138:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c8681678600/0x26940258de8eee97 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776384.314155:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c8681678600/0x26940258de8eee97 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776384.314175:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c8681678600/0x26940258de8eee97 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776384.314184:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776384.314243:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9db43398-240e-4f78-8778-c11d527e09a1+10:3274:x1876716471457280:12345-0@lo:103: Request processed in 191us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776384.314249:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789776384.314281:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9db43398-240e-4f78-8778-c11d527e09a1:3274:1876716471457280:0@lo:103: 00010000:00010000:2.0:1789776384.314350:0:5805:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c8681678600/0x26940258de8eee97 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.314359:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c8681678600/0x26940258de8eee97 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.314366:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c8681678600/0x26940258de8eee97 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789776384.314385:0:5805:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789776384.318379:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9db43398-240e-4f78-8778-c11d527e09a1:3276:1876716471457152:0@lo:103: 00000100:00100000:3.0:1789776384.318442:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9db43398-240e-4f78-8778-c11d527e09a1:3276:1876716471457024:0@lo:103: 00000100:00100000:1.0:1789776384.374772:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa597050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+9:6657:x1876716471456512:12345-0@lo:253: Request processed in 72719us (73053us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776384.374788:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789776384.374888:0:6657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:6657:1876716471456512:0@lo:253: 10000000:01000000:2.0:1789776384.374905:0:6657:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789776384.374909:0:6657:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789776384.374911:0:6657:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789776384.374912:0:6657:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789776384.374913:0:6657:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1789776384.374915:0:6657:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789776384.374916:0:6657:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789776384.374987:0:6657:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789776384.374990:0:6657:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789776384.374992:0:6657:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789776384.374993:0:6657:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789776384.375400:0:6657:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c86903b8800 from lustre-OST0000 10000000:01000000:2.0:1789776384.375427:0:6657:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789776384.375441:0:6657:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789776384.375448:0:6657:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c86aa63b370 local copy 10000000:01000000:2.0:1789776384.375452:0:6657:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789776384.375491:0:6657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c868afc7a00/0x26940258de8eee9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.375502:0:6657:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.106@tcp lock: ffff9c868afc7a00/0x26940258de8eee9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.375513:0:6657:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c868afc7a00/0x26940258de8eee9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776384.375532:0:6657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:6657:1876716471457408:0@lo:101: 00000100:00100000:2.0:1789776384.375578:0:6657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776384.375784:0:6657:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86878f0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789776384.375859:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471457408 00000100:00100000:0.0:1789776384.375865:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471457408 00000100:00100000:0.0:1789776384.375984:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789776384.375994:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa594450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+9:6657:x1876716471457408:12345-0@lo:101: 00010000:00010000:0.0:1789776384.376094:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776384.376113:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c8680030400/0x26940258de8eeea5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8eee9e expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776384.376273:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c8680030400/0x26940258de8eeea5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8eee9e expref: 10 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776384.376286:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c8680030400/0x26940258de8eeea5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8eee9e expref: 10 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776384.376317:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8680030400, rc 0) 00000100:00100000:0.0:1789776384.376363:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa594450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+10:6657:x1876716471457408:12345-0@lo:101: Request processed in 371us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776384.376369:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789776384.376452:0:6657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:6657:1876716471457408:0@lo:101: 00010000:00010000:2.0:1789776384.376471:0:6657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c868afc7a00/0x26940258de8eee9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x26940258de8eeea5 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.376479:0:6657:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c868afc7a00/0x26940258de8eee9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x26940258de8eeea5 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776384.376575:0:6657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:6657:1876716471457536:0@lo:501: 00000100:00100000:2.0:1789776384.376600:0:6657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776384.376769:0:6657:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86878f0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789776384.376864:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471457536 00000100:00100000:3.0:1789776384.376868:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471457536 00000100:00100000:3.0:1789776384.376895:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789776384.376902:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa596c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+10:6657:x1876716471457536:12345-0@lo:501: 00000100:00100000:3.0:1789776384.377317:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa596c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+10:6657:x1876716471457536:12345-0@lo:501: Request processed in 414us (714us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789776384.377324:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789776384.377404:0:6657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:6657:1876716471457536:0@lo:501: 10000000:01000000:2.0:1789776384.377418:0:6657:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789776384.377457:0:6657:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789776384.377463:0:6657:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c868afc7a00/0x26940258de8eee9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x26940258de8eeea5 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.377472:0:6657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c868afc7a00/0x26940258de8eee9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x26940258de8eeea5 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.377480:0:6657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9c868afc7a00/0x26940258de8eee9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x26940258de8eeea5 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.377506:0:6657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789776384.377529:0:6657:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c86903b8800 10000000:01000000:2.0:1789776384.377534:0:6657:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789776384.377538:0:6657:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9c86aa63b370 10000000:01000000:2.0:1789776384.377541:0:6657:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789776384.377544:0:6657:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9c86aa63b370 from 1 10000000:01000000:2.0:1789776384.377547:0:6657:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789776384.377567:0:6657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c868afc6000/0x26940258de8eeeac lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.377581:0:6657:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c868afc6000/0x26940258de8eeeac lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.377590:0:6657:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c868afc6000/0x26940258de8eeeac lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776384.377603:0:6657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:6657:1876716471457664:0@lo:101: 00010000:00010000:3.0:1789776384.377706:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789776384.377714:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c868afc7a00/0x26940258de8eee9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x26940258de8eeea5 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776384.377722:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc7a00 already unused, calling callback (ffffffffc1da0c20) 10000000:00010000:3.0:1789776384.377726:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c868afc7a00/0x26940258de8eee9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x26940258de8eeea5 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776384.377734:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c868afc7a00/0x26940258de8eee9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x26940258de8eeea5 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789776384.377741:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c868afc7a00/0x26940258de8eee9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x26940258de8eeea5 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776384.377747:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789776384.377766:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c868afc7a00/0x26940258de8eee9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x26940258de8eeea5 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776384.377783:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789776384.377803:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c868afc7a00/0x26940258de8eee9e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x26940258de8eeea5 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776384.377810:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c868afc7a00/0x26940258de8eee9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x26940258de8eeea5 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776384.377826:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776384.377828:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776384.377829:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776384.377836:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789776384.377847:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb4f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9db43398-240e-4f78-8778-c11d527e09a1:3273:1876716471457792:0@lo:103: 00000100:00100000:3.0:1789776384.377998:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776384.378263:0:6657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776384.378294:0:6657:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86878f0480 going to sleep for 11 seconds 00000100:00100000:3.0:1789776384.378390:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471457664 00000100:00100000:3.0:1789776384.378396:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471457664 00000100:00100000:3.0:1789776384.378428:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789776384.378449:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa596450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+10:6657:x1876716471457664:12345-0@lo:101: 00010000:00010000:3.0:1789776384.378462:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776384.378478:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c8681678200/0x26940258de8eeeb3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8eeeac expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776384.378496:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c8681678200/0x26940258de8eeeb3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8eeeac expref: 11 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776384.378506:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c8681678200/0x26940258de8eeeb3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8eeeac expref: 11 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776384.378515:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8681678200, rc 0) 00000100:00100000:3.0:1789776384.378556:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa596450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+11:6657:x1876716471457664:12345-0@lo:101: Request processed in 110us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776384.378562:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789776384.378726:0:6657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:6657:1876716471457664:0@lo:101: 00010000:00010000:2.0:1789776384.378740:0:6657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c868afc6000/0x26940258de8eeeac lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eeeb3 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.378749:0:6657:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c868afc6000/0x26940258de8eeeac lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8eeeb3 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776384.378766:0:6657:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789776384.378783:0:6657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c868afc6000/0x26940258de8eeeac lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eeeb3 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.378791:0:6657:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c868afc6000/0x26940258de8eeeac lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eeeb3 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776384.378798:0:6657:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789776384.378802:0:6657:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789776384.378807:0:6657:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1789776384.378809:0:6657:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789776384.378826:0:6657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c868afc7400/0x26940258de8eeeba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.378839:0:6657:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c868afc7400/0x26940258de8eeeba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.378847:0:6657:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c868afc7400/0x26940258de8eeeba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776384.378860:0:6657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:6657:1876716471457920:0@lo:101: 00000100:00100000:2.0:1789776384.378886:0:6657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776384.378898:0:6657:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86878f0480 going to sleep for 11 seconds 00000100:00100000:3.0:1789776384.378954:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471457920 00000100:00100000:3.0:1789776384.378959:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471457920 00000100:00100000:3.0:1789776384.378978:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789776384.378984:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa596050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+11:6657:x1876716471457920:12345-0@lo:101: 00010000:00010000:3.0:1789776384.378990:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776384.378998:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c8681679c00/0x26940258de8eeec1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8eeeba expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776384.379213:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c8681679c00/0x26940258de8eeec1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8eeeba expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776384.379256:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c8681679c00/0x26940258de8eeec1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8eeeba expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776384.379263:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8681679c00, rc 0) 00000100:00100000:3.0:1789776384.379291:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa596050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+12:6657:x1876716471457920:12345-0@lo:101: Request processed in 307us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776384.379297:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789776384.379428:0:6657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:6657:1876716471457920:0@lo:101: 00010000:00010000:2.0:1789776384.379451:0:6657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c868afc7400/0x26940258de8eeeba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eeec1 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.379459:0:6657:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c868afc7400/0x26940258de8eeeba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8eeec1 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776384.379558:0:6657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:6657:1876716471458048:0@lo:501: 00000100:00100000:2.0:1789776384.379584:0:6657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776384.379613:0:6657:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86878f0480 going to sleep for 11 seconds 00000100:00100000:3.0:1789776384.379729:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471458048 00000100:00100000:3.0:1789776384.379733:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471458048 00000100:00100000:3.0:1789776384.379802:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789776384.379810:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa595c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+12:6657:x1876716471458048:12345-0@lo:501: 00000100:00100000:3.0:1789776384.380109:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa595c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+12:6657:x1876716471458048:12345-0@lo:501: Request processed in 300us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776384.380116:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789776384.380248:0:6657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:6657:1876716471458048:0@lo:501: 00000100:00100000:2.0:1789776384.380275:0:6657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:6657:1876716471458176:0@lo:503: 00000100:00100000:2.0:1789776384.380313:0:6657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776384.380369:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471457792 00000100:00100000:0.0:1789776384.380374:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471457792 00000100:00100000:0.0:1789776384.380409:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789776384.380415:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9db43398-240e-4f78-8778-c11d527e09a1+12:3273:x1876716471457792:12345-0@lo:103: 00010000:00010000:0.0:1789776384.380424:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776384.380451:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c8680030400/0x26940258de8eeea5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26940258de8eee9e expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776384.380465:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776384.380499:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9db43398-240e-4f78-8778-c11d527e09a1+11:3273:x1876716471457792:12345-0@lo:103: Request processed in 85us (2501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776384.380505:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789776384.380533:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb4f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9db43398-240e-4f78-8778-c11d527e09a1:3273:1876716471457792:0@lo:103: 00000100:00100000:2.0:1789776384.380823:0:6657:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86878f0480 going to sleep for 11 seconds 00000100:00100000:1.0:1789776384.380896:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471458176 00000100:00100000:1.0:1789776384.380901:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471458176 00000100:00100000:1.0:1789776384.380925:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789776384.380932:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa595850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+11:6657:x1876716471458176:12345-0@lo:503: 00000100:00100000:1.0:1789776384.381376:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa595850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+11:6657:x1876716471458176:12345-0@lo:503: Request processed in 444us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776384.381384:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789776384.381590:0:6657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:6657:1876716471458176:0@lo:503: 00000040:00080000:2.0:1789776384.381997:0:6657:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789776384.384498:0:6657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:6657:1876716471458304:0@lo:502: 00000100:00100000:2.0:1789776384.384602:0:6657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776384.384757:0:6657:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86878f0480 going to sleep for 11 seconds 00000100:00100000:1.0:1789776384.384887:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471458304 00000100:00100000:1.0:1789776384.384896:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471458304 00000100:00100000:1.0:1789776384.384978:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789776384.384988:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa597850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+11:6657:x1876716471458304:12345-0@lo:502: 00000100:00100000:1.0:1789776384.385393:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa597850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+11:6657:x1876716471458304:12345-0@lo:502: Request processed in 407us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776384.385409:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789776384.385512:0:6657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:6657:1876716471458304:0@lo:502: 00000040:00080000:2.0:1789776384.385925:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789776384.385983:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1789776384.386105:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1789776384.386278:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1789776384.386315:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1789776384.386366:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1789776384.386397:0:6657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:6657:1876716471458432:0@lo:502: 00000100:00100000:2.0:1789776384.386453:0:6657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776384.386819:0:6657:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86878f0480 going to sleep for 11 seconds 00000100:00100000:3.0:1789776384.386908:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471458432 00000100:00100000:3.0:1789776384.386920:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471458432 00000100:00100000:3.0:1789776384.386953:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789776384.386961:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa596850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+11:6657:x1876716471458432:12345-0@lo:502: 00000100:00100000:3.0:1789776384.387345:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa596850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+11:6657:x1876716471458432:12345-0@lo:502: Request processed in 383us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776384.387353:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789776384.387480:0:6657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:6657:1876716471458432:0@lo:502: 00000040:00080000:2.0:1789776384.387613:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1789776384.387699:0:6657:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1789776384.388723:0:6675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789776384.388732:0:6675:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1789776384.388738:0:6675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776384.388740:0:6675:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789776384.388746:0:6675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789776384.388762:0:6675:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9c86a01ab370) 00000020:00000080:2.0:1789776384.388784:0:6675:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789776384.388790:0:6675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789776384.388849:0:6675:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c86903b8800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789776384.388856:0:6675:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789776384.388863:0:6675:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x26940258de8eeecf 00010000:00010000:1.0:1789776384.397571:0:6675:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1789776384.398212:0:6675:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1789776384.401877:0:6675:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789776384.402820:0:6675:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1789776384.411605:0:6675:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1789776384.412652:0:6675:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1789776384.414021:0:6675:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789776384.414034:0:6675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789776384.414040:0:6675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776384.414042:0:6675:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789776384.414045:0:6675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789776384.414050:0:6675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776384.414052:0:6675:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789776384.414055:0:6675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789776384.414057:0:6675:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789776384.414276:0:6675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789776384.414281:0:6675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776384.414282:0:6675:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789776384.414286:0:6675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1789776384.414459:0:6657:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1789776384.414488:0:6657:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789776384.414518:0:6657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c868afc7400/0x26940258de8eeeba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eeec1 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.414545:0:6657:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c868afc7400/0x26940258de8eeeba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eeec1 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776384.414553:0:6657:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c86903b8800 from 1 10000000:01000000:2.0:1789776384.414557:0:6657:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789776384.414596:0:6657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c868afc7200/0x26940258de8eeed6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.414604:0:6657:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c868afc7200/0x26940258de8eeed6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.414625:0:6657:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c868afc7200/0x26940258de8eeed6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776384.414651:0:6657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:6657:1876716471458560:0@lo:101: 00000100:00100000:2.0:1789776384.414723:0:6657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776384.414770:0:6657:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86878f0300 going to sleep for 11 seconds 00000100:00100000:2.0:1789776384.416763:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471458560 00000100:00100000:2.0:1789776384.416777:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471458560 00000100:00100000:2.0:1789776384.416837:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789776384.416848:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa597c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+11:6657:x1876716471458560:12345-0@lo:101: 00010000:00010000:2.0:1789776384.416865:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776384.416883:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c868afc7000/0x26940258de8eeedd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8eeed6 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.416925:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c868afc7000/0x26940258de8eeedd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8eeed6 expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.416938:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c868afc7000/0x26940258de8eeedd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8eeed6 expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.416954:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c868afc7000, rc 0) 00000100:00100000:2.0:1789776384.417043:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa597c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+12:6657:x1876716471458560:12345-0@lo:101: Request processed in 197us (2320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776384.417051:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789776384.417329:0:6657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:6657:1876716471458560:0@lo:101: 00010000:00010000:2.0:1789776384.417350:0:6657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c868afc7200/0x26940258de8eeed6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eeedd expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.417360:0:6657:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c868afc7200/0x26940258de8eeed6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8eeedd expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776384.417488:0:6657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:6657:1876716471458688:0@lo:501: 00000100:00100000:2.0:1789776384.417522:0:6657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776384.417559:0:6657:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86878f0300 going to sleep for 11 seconds 00000100:00100000:1.0:1789776384.417737:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471458688 00000100:00100000:1.0:1789776384.417742:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471458688 00000100:00100000:1.0:1789776384.417778:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789776384.417786:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa594850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+12:6657:x1876716471458688:12345-0@lo:501: 00000100:00100000:1.0:1789776384.418058:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa594850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+12:6657:x1876716471458688:12345-0@lo:501: Request processed in 272us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776384.418065:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789776384.418799:0:6657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:6657:1876716471458688:0@lo:501: 00000100:00100000:2.0:1789776384.418839:0:6657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:6657:1876716471458816:0@lo:503: 00000100:00100000:2.0:1789776384.418888:0:6657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776384.419736:0:6657:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86878f0300 going to sleep for 11 seconds 00000100:00100000:1.0:1789776384.422745:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471458816 00000100:00100000:1.0:1789776384.422759:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471458816 00000100:00100000:1.0:1789776384.422859:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789776384.422877:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa597450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+12:6657:x1876716471458816:12345-0@lo:503: 00000100:00100000:1.0:1789776384.424257:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa597450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+12:6657:x1876716471458816:12345-0@lo:503: Request processed in 1375us (5361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776384.424270:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789776384.424384:0:6657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:6657:1876716471458816:0@lo:503: 00000040:00080000:3.0:1789776384.424814:0:6657:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789776384.424915:0:6657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb4f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:6657:1876716471458944:0@lo:502: 00000100:00100000:3.0:1789776384.424962:0:6657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776384.427013:0:6657:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8687ef7480 going to sleep for 11 seconds 00000100:00100000:2.0:1789776384.427549:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471458944 00000100:00100000:2.0:1789776384.427559:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471458944 00000100:00100000:2.0:1789776384.427605:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789776384.427614:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa594050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+12:6657:x1876716471458944:12345-0@lo:502: 00000100:00100000:2.0:1789776384.427895:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa594050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+12:6657:x1876716471458944:12345-0@lo:502: Request processed in 281us (2932us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776384.427903:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789776384.428335:0:6657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb4f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:6657:1876716471458944:0@lo:502: 00000040:00080000:3.0:1789776384.428656:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1789776384.428711:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1789776384.428751:0:6657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb4f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:6657:1876716471459072:0@lo:502: 00000100:00100000:3.0:1789776384.428798:0:6657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776384.428829:0:6657:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8687ef7480 going to sleep for 11 seconds 00000100:00100000:2.0:1789776384.428960:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471459072 00000100:00100000:2.0:1789776384.428966:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471459072 00000100:00100000:2.0:1789776384.429005:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789776384.429013:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa595050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+12:6657:x1876716471459072:12345-0@lo:502: 00000100:00100000:2.0:1789776384.429293:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa595050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+12:6657:x1876716471459072:12345-0@lo:502: Request processed in 280us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776384.429301:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789776384.429490:0:6657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb4f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:6657:1876716471459072:0@lo:502: 00000040:00080000:3.0:1789776384.429581:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1789776384.429591:0:6657:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789776384.430044:0:6679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789776384.430055:0:6679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776384.430058:0:6679:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789776384.430063:0:6679:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c86903b8800 00000020:00000080:3.0:1789776384.430066:0:6679:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789776384.430097:0:6679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789776384.430101:0:6679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776384.430110:0:6679:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789776384.430113:0:6679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1789776384.430345:0:6657:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789776384.430367:0:6657:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789776384.430389:0:6657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c868afc7200/0x26940258de8eeed6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eeedd expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776384.430401:0:6657:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c868afc7200/0x26940258de8eeed6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eeedd expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776384.430475:0:6657:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789776384.430479:0:6657:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c86903b8800 10000000:01000000:1.0:1789776384.430483:0:6657:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c86903b8800 10000000:01000000:1.0:1789776384.430488:0:6657:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789776384.430494:0:6657:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c86903b8800 from 1 10000000:01000000:1.0:1789776384.430498:0:6657:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789776384.430530:0:6657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c86829e0a00/0x26940258de8eeee4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776384.430539:0:6657:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c86829e0a00/0x26940258de8eeee4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776384.430551:0:6657:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c86829e0a00/0x26940258de8eeee4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776384.430568:0:6657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa654e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:6657:1876716471459200:0@lo:101: 00000100:00100000:1.0:1789776384.430623:0:6657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776384.430668:0:6657:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86878b6840 going to sleep for 11 seconds 00000100:00100000:2.0:1789776384.430765:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471459200 00000100:00100000:2.0:1789776384.430771:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471459200 00000100:00100000:2.0:1789776384.430813:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789776384.430823:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa594c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+12:6657:x1876716471459200:12345-0@lo:101: 00010000:00010000:2.0:1789776384.430835:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776384.430850:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c868afc7a00/0x26940258de8eeeeb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8eeee4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.430877:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c868afc7a00/0x26940258de8eeeeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8eeee4 expref: 13 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.430888:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c868afc7a00/0x26940258de8eeeeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8eeee4 expref: 13 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776384.430898:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c868afc7a00, rc 0) 00000100:00100000:2.0:1789776384.430942:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa594c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+13:6657:x1876716471459200:12345-0@lo:101: Request processed in 121us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776384.430949:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789776384.431023:0:6657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa654e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:6657:1876716471459200:0@lo:101: 00010000:00010000:3.0:1789776384.431038:0:6657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c86829e0a00/0x26940258de8eeee4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eeeeb expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776384.431047:0:6657:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c86829e0a00/0x26940258de8eeee4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8eeeeb expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776384.431137:0:6657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb4f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:6657:1876716471459328:0@lo:501: 00000100:00100000:3.0:1789776384.431164:0:6657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776384.431188:0:6657:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8687ef7300 going to sleep for 11 seconds 00000100:00100000:2.0:1789776384.431303:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471459328 00000100:00100000:2.0:1789776384.431308:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471459328 00000100:00100000:2.0:1789776384.431331:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789776384.431338:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+13:6657:x1876716471459328:12345-0@lo:501: 00000100:00100000:2.0:1789776384.431564:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+13:6657:x1876716471459328:12345-0@lo:501: Request processed in 226us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776384.431572:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789776384.431695:0:6657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb4f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:6657:1876716471459328:0@lo:501: 00000100:00100000:3.0:1789776384.431721:0:6657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb4f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:6657:1876716471459456:0@lo:503: 00000100:00100000:3.0:1789776384.431759:0:6657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776384.431781:0:6657:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8687ef7300 going to sleep for 11 seconds 00000100:00100000:1.0:1789776384.431843:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471459456 00000100:00100000:1.0:1789776384.431847:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471459456 00000100:00100000:1.0:1789776384.431880:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789776384.431887:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+13:6657:x1876716471459456:12345-0@lo:503: 00000100:00100000:1.0:1789776384.432023:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+13:6657:x1876716471459456:12345-0@lo:503: Request processed in 136us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776384.432030:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789776384.432113:0:6657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb4f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:6657:1876716471459456:0@lo:503: 00000040:00080000:3.0:1789776384.432380:0:6657:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789776384.432452:0:6657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb4f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:6657:1876716471459584:0@lo:502: 00000100:00100000:3.0:1789776384.432487:0:6657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776384.432513:0:6657:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8691eed480 going to sleep for 11 seconds 00000100:00100000:1.0:1789776384.432662:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471459584 00000100:00100000:1.0:1789776384.432667:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471459584 00000100:00100000:1.0:1789776384.432695:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789776384.432701:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa593c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+13:6657:x1876716471459584:12345-0@lo:502: 00000100:00100000:1.0:1789776384.432842:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa593c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+13:6657:x1876716471459584:12345-0@lo:502: Request processed in 141us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776384.432849:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789776384.432948:0:6657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb4f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:6657:1876716471459584:0@lo:502: 00000040:00080000:3.0:1789776384.433304:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789776384.433347:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789776384.433373:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789776384.433408:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789776384.433502:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789776384.433554:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789776384.433581:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789776384.433606:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789776384.433646:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789776384.433691:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789776384.433724:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789776384.433771:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789776384.433806:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789776384.433835:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789776384.433893:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789776384.433930:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789776384.433963:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789776384.434016:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789776384.434053:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789776384.434385:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789776384.434505:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789776384.434544:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789776384.434574:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789776384.434623:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789776384.434658:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1789776384.434706:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1789776384.434754:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1789776384.434789:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1789776384.434829:0:6657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb4f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:6657:1876716471459712:0@lo:502: 00000100:00100000:3.0:1789776384.436584:0:6657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776384.436674:0:6657:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8691eed480 going to sleep for 11 seconds 00000100:00100000:1.0:1789776384.436826:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471459712 00000100:00100000:1.0:1789776384.436835:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471459712 00000100:00100000:1.0:1789776384.436944:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789776384.436956:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa590850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+13:6657:x1876716471459712:12345-0@lo:502: 00000100:00100000:1.0:1789776384.437244:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa590850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+13:6657:x1876716471459712:12345-0@lo:502: Request processed in 262us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776384.437252:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789776384.437343:0:6657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb4f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:6657:1876716471459712:0@lo:502: 00000040:00080000:3.0:1789776384.437467:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1789776384.437481:0:6657:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1789776384.438129:0:6680:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789776384.438143:0:6680:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9c86b9900000) 00000020:00000080:3.0:1789776384.438170:0:6680:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1789776384.438346:0:6680:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c86903b8800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789776384.438351:0:6680:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c86903b8800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789776384.438354:0:6680:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c86903b8800 3 00010000:00080000:3.0:1789776384.438391:0:6680:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c86bf5f3800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.106@tcp at head 00010000:00010000:3.0:1789776384.440425:0:6680:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1789776384.440889:0:6680:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789776384.440925:0:6680:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789776384.440953:0:6680:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x26940258de8eeef9 00000100:00080000:3.0:1789776384.440965:0:6680:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789776384.440972:0:6680:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c86bf5f3800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1789776384.441020:0:6680:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c86bb4f0380 x1876716471459840/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789776384.441050:0:6680:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789776384.441193:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb4f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3272:1876716471459840:0@lo:38: 00000100:00100000:2.0:1789776384.441288:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776384.441569:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789776384.441581:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86af8ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876716471459968:0@lo:400: 00000100:00100000:0.0:1789776384.441613:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776384.441865:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471459840 00000100:00100000:3.0:1789776384.441872:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471459840 00000100:00100000:3.0:1789776384.441898:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471459968 00000100:00100000:3.0:1789776384.441901:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471459968 00000100:00100000:3.0:1789776384.441924:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789776384.441934:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876716471459968:12345-0@lo:400: 00000100:00100000:3.0:1789776384.441991:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876716471459968:12345-0@lo:400: Request processed in 58us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776384.441998:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789776384.442012:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789776384.442017:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3272:x1876716471459840:12345-0@lo:38: 00010000:00080000:3.0:1789776384.442041:0:5813:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 137 last 0 00000020:00000080:3.0:1789776384.443053:0:5813:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x26940258de8eef00 00000004:00100000:3.0:1789776384.443074:0:5813:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789776384.443211:0:5813:0:(import.c:65:import_set_state_nolock()) ffff9c86bf710800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789776384.443353:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3272:x1876716471459840:12345-0@lo:38: Request processed in 1333us (2064us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776384.443363:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789776384.443494:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c86af8ca680 x1876716471459968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776384.443510:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86af8ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876716471459968:0@lo:400: 00000040:00080000:0.0:1789776384.443688:0:6680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1789776384.443805:0:6657:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1789776384.443838:0:6657:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789776384.443851:0:6657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c86829e0a00/0x26940258de8eeee4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eeeeb expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776384.443861:0:6657:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c86829e0a00/0x26940258de8eeee4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eeeeb expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789776384.443907:0:6657:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789776384.443909:0:6657:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789776384.443910:0:6657:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789776384.443912:0:6657:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789776384.443913:0:6657:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789776384.443914:0:6657:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789776384.443916:0:6657:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789776384.443917:0:6657:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789776384.443919:0:6657:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789776384.443920:0:6657:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789776384.443922:0:6657:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789776384.443926:0:6657:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1789776384.443929:0:6657:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789776384.443930:0:6657:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789776384.443931:0:6657:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789776384.443932:0:6657:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789776384.443934:0:6657:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789776384.443935:0:6657:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789776384.443936:0:6657:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789776384.443937:0:6657:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789776384.443938:0:6657:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789776384.443939:0:6657:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789776384.443940:0:6657:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789776384.443957:0:6657:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789776384.443972:0:6657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86af8ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:6657:1876716471460096:0@lo:253: 00000100:00100000:0.0:1789776384.444018:0:6657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776384.444047:0:6657:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86917950c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776384.444118:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471460096 00000100:00100000:3.0:1789776384.444124:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471460096 00000100:00100000:3.0:1789776384.444166:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789776384.444175:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+13:6657:x1876716471460096:12345-0@lo:253: 20000000:01000000:3.0:1789776384.444195:0:5804:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789776384.444210:0:5804:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:2.0:1789776384.447591:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c86bb4f0380 x1876716471459840/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789776394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776384.447607:0:3272:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789776384.447617:0:3272:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1789776384.447626:0:3272:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789776384.447632:0:3272:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789776384.447635:0:3272:0:(import.c:65:import_set_state_nolock()) ffff9c86bf5f3800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789776384.447642:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb4f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3272:1876716471459840:0@lo:38: 20000000:01000000:3.0:1789776384.487171:0:5804:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789776384.487191:0:5804:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1789776384.487329:0:5827:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789776384.487334:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789776384.487358:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c86829e1800/0x26940258de8eef07 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776384.487378:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c8680031600/0x26940258de8eee5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8eee58 expref: 13 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776384.487405:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c86829e1800/0x26940258de8eef07 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776384.487457:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c8680031600/0x26940258de8eee5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26940258de8eee58 expref: 13 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776384.487471:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c8680031600/0x26940258de8eee5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26940258de8eee58 expref: 13 pid: 5806 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776384.487486:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa655180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5827:1876716471460224:0@lo:104: 00000100:00100000:1.0:1789776384.487558:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776384.487623:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86878b6840 going to sleep for 11 seconds 00000100:00100000:3.0:1789776384.488746:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471460224 00000100:00100000:3.0:1789776384.488758:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471460224 00000100:00100000:3.0:1789776384.488810:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789776384.488820:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa657480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9db43398-240e-4f78-8778-c11d527e09a1+3:5827:x1876716471460224:12345-0@lo:104: 00010000:00010000:3.0:1789776384.488836:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c8680030a00/0x26940258de8eee58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8eee5f expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776384.488915:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789776384.488921:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa657480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9db43398-240e-4f78-8778-c11d527e09a1+3:5827:x1876716471460224:12345-0@lo:104: Request processed in 103us (1364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776384.488928:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1789776384.488949:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789776384.488954:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c8680030a00/0x26940258de8eee58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8eee5f expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776384.488962:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8680030a00 already unused, calling callback (ffffffffc1da0c20) 10000000:00010000:3.0:1789776384.488966:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c8680030a00/0x26940258de8eee58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26940258de8eee5f expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776384.488986:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c8680030a00/0x26940258de8eee58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26940258de8eee5f expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789776384.488993:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c8680030a00/0x26940258de8eee58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26940258de8eee5f expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776384.488999:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789776384.489029:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c8680030a00/0x26940258de8eee58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eee5f expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776384.489035:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789776384.489052:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c8680030a00/0x26940258de8eee58 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eee5f expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776384.489059:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c8680030a00/0x26940258de8eee58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eee5f expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776384.489073:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776384.489075:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776384.489077:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776384.489304:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb4f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9db43398-240e-4f78-8778-c11d527e09a1:3276:1876716471460352:0@lo:103: 00000100:00100000:3.0:1789776384.489341:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776384.489395:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa655180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5827:1876716471460224:0@lo:104: 00010000:00010000:3.0:1789776384.489413:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c86829e1800/0x26940258de8eef07 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776384.489479:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471460352 00000100:00100000:1.0:1789776384.489483:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471460352 00010000:00010000:1.0:1789776384.489502:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c8680031600/0x26940258de8eee5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8eee58 expref: 14 pid: 5806 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776384.489529:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789776384.489535:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c869880f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9db43398-240e-4f78-8778-c11d527e09a1+14:3276:x1876716471460352:12345-0@lo:103: 00010000:00010000:1.0:1789776384.489545:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776384.489550:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c8680031600/0x26940258de8eee5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8eee58 expref: 14 pid: 5806 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776384.489559:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c8680031600/0x26940258de8eee5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26940258de8eee58 expref: 14 pid: 5806 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776384.489574:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c8680031600/0x26940258de8eee5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26940258de8eee58 expref: 14 pid: 5806 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776384.489599:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c86829e1800/0x26940258de8eef07 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776384.489606:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c86829e1800/0x26940258de8eef07 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789776384.489619:0:5797:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002285514s 00010000:00010000:1.0:1789776384.489624:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c86829e1800/0x26940258de8eef07 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776384.489630:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c86829e1800/0x26940258de8eef07 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776384.489637:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c86829e1800/0x26940258de8eef07 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776384.489643:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c86829e1800/0x26940258de8eef07 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776384.489648:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86829e1800 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:1.0:1789776384.489653:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c86829e1800/0x26940258de8eef07 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776384.489660:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c86829e1800/0x26940258de8eef07 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776384.489672:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c86829e1800/0x26940258de8eef07 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776384.489680:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776384.489721:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c869880f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9db43398-240e-4f78-8778-c11d527e09a1+13:3276:x1876716471460352:12345-0@lo:103: Request processed in 186us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776384.489728:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789776384.489810:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb4f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9db43398-240e-4f78-8778-c11d527e09a1:3276:1876716471460352:0@lo:103: 00010000:00010000:3.0:1789776384.489826:0:5827:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c86829e1800/0x26940258de8eef07 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776384.489838:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c86829e1800/0x26940258de8eef07 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776384.489844:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c86829e1800/0x26940258de8eef07 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776384.503787:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+12:6657:x1876716471460096:12345-0@lo:253: Request processed in 59601us (59756us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776384.503801:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789776384.503950:0:6657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86af8ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:6657:1876716471460096:0@lo:253: 10000000:01000000:3.0:1789776384.503966:0:6657:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789776384.503970:0:6657:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789776384.503972:0:6657:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789776384.503973:0:6657:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789776384.503975:0:6657:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789776384.503976:0:6657:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789776384.503978:0:6657:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789776384.503979:0:6657:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789776384.503981:0:6657:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789776384.503982:0:6657:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789776384.503984:0:6657:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789776384.503985:0:6657:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789776384.504003:0:6657:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789776384.509461:0:6657:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1789776384.509646:0:6657:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789776384.509867:0:6657:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789776384.510051:0:6657:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789776384.510341:0:6657:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789776384.510603:0:6657:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789776384.512764:0:6657:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1789776384.726926:0:6657:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1789776384.726934:0:6657:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1789776384.726969:0:6657:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789776384.727023:0:6657:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.106@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789776384.727039:0:6657:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1789776384.727071:0:6657:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1789776384.920554:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776385.942252:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789776386.068968:0:5808:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789776386.068988:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c86c01a7000 from 21 10000000:01000000:0.0:1789776386.068997:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789776386.069077:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8680031c00/0x26940258de8eef0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776386.069093:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c8680031c00/0x26940258de8eef0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776386.069748:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c8680031c00/0x26940258de8eef0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776386.069782:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86af8cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471460480:0@lo:101: 00000100:00100000:0.0:1789776386.069895:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776386.069965:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8698858e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789776386.072820:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471460480 00000100:00100000:1.0:1789776386.072846:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471460480 00000100:00100000:1.0:1789776386.073393:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789776386.073410:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa590050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+12:5808:x1876716471460480:12345-0@lo:101: 00010000:00010000:1.0:1789776386.073445:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776386.073475:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c86829e1000/0x26940258de8eef15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8eef0e expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776386.073518:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c86829e1000/0x26940258de8eef15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8eef0e expref: 13 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776386.073534:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c86829e1000/0x26940258de8eef15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8eef0e expref: 13 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776386.073545:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86829e1000, rc 0) 00000100:00100000:1.0:1789776386.073665:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa590050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+13:5808:x1876716471460480:12345-0@lo:101: Request processed in 259us (3770us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776386.073675:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789776386.075482:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86af8cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471460480:0@lo:101: 00010000:00010000:1.0:1789776386.075524:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c8680031c00/0x26940258de8eef0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eef15 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776386.075539:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c8680031c00/0x26940258de8eef0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8eef15 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776386.075649:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa656680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471460608:0@lo:501: 00000100:00100000:1.0:1789776386.075715:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776386.075759:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86aa47d240 going to sleep for 11 seconds 00000100:00100000:0.0:1789776386.076435:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471460608 00000100:00100000:0.0:1789776386.076450:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471460608 00000100:00100000:0.0:1789776386.076513:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789776386.076524:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+13:5808:x1876716471460608:12345-0@lo:501: 00000100:00100000:0.0:1789776386.077025:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+13:5808:x1876716471460608:12345-0@lo:501: Request processed in 501us (1308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776386.077034:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789776386.079043:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa656680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471460608:0@lo:501: 00000100:00100000:1.0:1789776386.079155:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa656680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471460736:0@lo:503: 00000100:00100000:1.0:1789776386.079289:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776386.079343:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86aa47d240 going to sleep for 11 seconds 00000100:00100000:1.0:1789776386.084015:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471460736 00000100:00100000:1.0:1789776386.084038:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471460736 00000100:00100000:1.0:1789776386.084141:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789776386.084154:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+13:5808:x1876716471460736:12345-0@lo:503: 00000100:00100000:1.0:1789776386.084684:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+13:5808:x1876716471460736:12345-0@lo:503: Request processed in 530us (5394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776386.084694:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789776386.084794:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa656680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471460736:0@lo:503: 00000100:00100000:0.0:1789776386.103083:0:6750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86af8c8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:6750:1876716471460864:0@lo:502: 00000100:00100000:0.0:1789776386.103250:0:6750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776386.103319:0:6750:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8698858000 going to sleep for 11 seconds 00000100:00100000:2.0:1789776386.103476:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471460864 00000100:00100000:2.0:1789776386.103487:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471460864 00000100:00100000:2.0:1789776386.103556:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789776386.103568:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa591450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+13:6750:x1876716471460864:12345-0@lo:502: 00000100:00100000:2.0:1789776386.103997:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa591450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+13:6750:x1876716471460864:12345-0@lo:502: Request processed in 428us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776386.104007:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789776386.104315:0:6750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86af8c8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:6750:1876716471460864:0@lo:502: 00000100:00100000:0.0:1789776386.104392:0:6750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86af8c8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:6750:1876716471460992:0@lo:502: 00000100:00100000:0.0:1789776386.104447:0:6750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776386.104477:0:6750:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8698858000 going to sleep for 11 seconds 00000100:00100000:1.0:1789776386.104507:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471460992 00000100:00100000:1.0:1789776386.104513:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471460992 00000100:00100000:1.0:1789776386.104554:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789776386.104564:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa593050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+13:6750:x1876716471460992:12345-0@lo:502: 00000100:00100000:1.0:1789776386.104796:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa593050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+13:6750:x1876716471460992:12345-0@lo:502: Request processed in 233us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776386.104804:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789776386.104913:0:6750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86af8c8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:6750:1876716471460992:0@lo:502: 00000040:00080000:0.0:1789776386.105006:0:6750:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1789776386.105208:0:5808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1789776386.105251:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789776386.105263:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8680031c00/0x26940258de8eef0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eef15 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776386.105276:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c8680031c00/0x26940258de8eef0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eef15 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776386.105286:0:5808:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789776386.105290:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c86c01a7000 from 4 10000000:01000000:1.0:1789776386.105294:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789776386.105330:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c86829e0000/0x26940258de8eef1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776386.105339:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c86829e0000/0x26940258de8eef1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776386.105350:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c86829e0000/0x26940258de8eef1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776386.105365:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa656680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471461120:0@lo:101: 00000100:00100000:1.0:1789776386.105400:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776386.105445:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471461120 00000100:00100000:2.0:1789776386.105450:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471461120 00000100:00100000:1.0:1789776386.105451:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86aa47d480 going to sleep for 11 seconds 00000100:00100000:2.0:1789776386.105487:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789776386.105494:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa590450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+13:5808:x1876716471461120:12345-0@lo:101: 00010000:00010000:2.0:1789776386.105507:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776386.105534:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c868afc7800/0x26940258de8eef23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8eef1c expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776386.105565:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c868afc7800/0x26940258de8eef23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8eef1c expref: 14 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776386.105579:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c868afc7800/0x26940258de8eef23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8eef1c expref: 14 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776386.105591:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c868afc7800, rc 0) 00000100:00100000:2.0:1789776386.105635:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa590450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+14:5808:x1876716471461120:12345-0@lo:101: Request processed in 141us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776386.105641:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789776386.105703:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa656680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471461120:0@lo:101: 00010000:00010000:1.0:1789776386.105718:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c86829e0000/0x26940258de8eef1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eef23 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776386.105739:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c86829e0000/0x26940258de8eef1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8eef23 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776386.105857:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa656680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471461248:0@lo:256: 00000100:00100000:1.0:1789776386.105892:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776386.105914:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86aa47d480 going to sleep for 11 seconds 00000100:00100000:0.0:1789776386.106016:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471461248 00000100:00100000:0.0:1789776386.106020:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471461248 00000100:00100000:0.0:1789776386.106054:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789776386.106062:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa592c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+14:5808:x1876716471461248:12345-0@lo:256: 20000000:01000000:0.0:1789776386.106186:0:5804:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789776386.106209:0:5804:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789776386.106213:0:5804:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1789776386.106352:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa592c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+14:5808:x1876716471461248:12345-0@lo:256: Request processed in 291us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776386.106359:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789776386.106526:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa656680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471461248:0@lo:256: 10000000:01000000:1.0:1789776386.106580:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789776386.106588:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c86829e0000/0x26940258de8eef1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eef23 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776386.106596:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c86829e0000/0x26940258de8eef1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eef23 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776386.106604:0:5808:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789776386.106607:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1789776386.106610:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789776386.106632:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c86829e1a00/0x26940258de8eef2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776386.106640:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c86829e1a00/0x26940258de8eef2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776386.106648:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c86829e1a00/0x26940258de8eef2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776386.106661:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa656680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471461376:0@lo:101: 00000100:00100000:1.0:1789776386.106698:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776386.106730:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86aa47d480 going to sleep for 11 seconds 00000100:00100000:0.0:1789776386.110015:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471461376 00000100:00100000:0.0:1789776386.110039:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471461376 00000100:00100000:0.0:1789776386.111081:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789776386.111115:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+14:5808:x1876716471461376:12345-0@lo:101: 00010000:00010000:0.0:1789776386.111140:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776386.111169:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c8680030800/0x26940258de8eef31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8eef2a expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776386.111207:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c8680030800/0x26940258de8eef31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8eef2a expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776386.111237:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c8680030800/0x26940258de8eef31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8eef2a expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776386.111249:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8680030800, rc 0) 00000100:00100000:0.0:1789776386.111369:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+15:5808:x1876716471461376:12345-0@lo:101: Request processed in 275us (4670us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776386.111402:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789776386.111643:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa656680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471461376:0@lo:101: 00010000:00010000:1.0:1789776386.111670:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c86829e1a00/0x26940258de8eef2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eef31 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776386.111684:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c86829e1a00/0x26940258de8eef2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8eef31 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776386.111786:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa656680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471461504:0@lo:501: 00000100:00100000:1.0:1789776386.111826:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776386.116596:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86aa47d480 going to sleep for 11 seconds 00000100:00100000:2.0:1789776386.116663:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471461504 00000100:00100000:2.0:1789776386.116677:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471461504 00000100:00100000:2.0:1789776386.116756:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789776386.116768:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa592050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+15:5808:x1876716471461504:12345-0@lo:501: 00000100:00100000:2.0:1789776386.117513:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa592050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+15:5808:x1876716471461504:12345-0@lo:501: Request processed in 744us (5682us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776386.117523:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789776386.117596:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa656680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471461504:0@lo:501: 00000100:00100000:2.0:1789776386.117673:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471461632:0@lo:503: 00000100:00100000:2.0:1789776386.117728:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776386.117759:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86a00da600 going to sleep for 11 seconds 00000100:00100000:1.0:1789776386.117885:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471461632 00000100:00100000:1.0:1789776386.117890:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471461632 00000100:00100000:1.0:1789776386.117915:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789776386.117922:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+15:5808:x1876716471461632:12345-0@lo:503: 00000100:00100000:1.0:1789776386.118688:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+15:5808:x1876716471461632:12345-0@lo:503: Request processed in 761us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776386.118697:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789776386.118700:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471461632:0@lo:503: 00000100:00100000:1.0:1789776386.119306:0:6752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa655c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:6752:1876716471461760:0@lo:502: 00000100:00100000:1.0:1789776386.119360:0:6752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776386.119385:0:6752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86aa47d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776386.120030:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471461760 00000100:00100000:0.0:1789776386.120039:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471461760 00000100:00100000:0.0:1789776386.120096:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789776386.120236:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa591850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+15:6752:x1876716471461760:12345-0@lo:502: 00000100:00100000:0.0:1789776386.120598:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa591850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+15:6752:x1876716471461760:12345-0@lo:502: Request processed in 491us (1237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776386.120606:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789776386.120673:0:6752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa655c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:6752:1876716471461760:0@lo:502: 00000020:01000000:0.0:1789776386.120705:0:6752:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789776386.120715:0:6752:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789776386.120724:0:6752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776386.120727:0:6752:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789776386.120733:0:6752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789776386.120738:0:6752:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.106@tcp to nid 0x20000c0a8ca6a (192.168.202.106@tcp) 00000020:01000000:0.0:1789776386.120768:0:6752:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789776386.120771:0:6752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789776386.120806:0:6752:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9c8692064d28) 00000020:00000080:0.0:1789776386.121756:0:6752:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1789776386.121772:0:6752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789776386.122350:0:6752:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1789776386.122359:0:6752:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789776386.122372:0:6752:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x26940258de8eef3f 00010000:00080000:0.0:1789776386.122429:0:6752:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c86bc8e1000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.106@tcp at head 00010000:00010000:0.0:1789776386.122726:0:6752:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1789776386.185655:0:6752:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789776386.185692:0:6752:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789776386.187777:0:6752:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789776386.188643:0:6752:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789776386.188711:0:6752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1789776386.188787:0:6752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1789776386.191856:0:6754:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789776386.191865:0:6754:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789776386.196697:0:6752:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789776386.196719:0:6752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789776386.196926:0:6752:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789776386.196958:0:6752:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x26940258de8eef46 00000100:00080000:1.0:1789776386.196972:0:6752:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789776386.196986:0:6752:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c86bc8e1000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1789776386.197244:0:6752:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c86aa654a80 x1876716471461888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789776386.197278:0:6752:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1789776386.197307:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa654a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3272:1876716471461888:0@lo:8: 00000100:00100000:1.0:1789776386.197375:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa656300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3273:1876716471462016:0@lo:400: 00000100:00100000:1.0:1789776386.197425:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776386.197425:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776386.197597:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789776386.197603:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa655880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3273:1876716471462144:0@lo:400: 00000100:00100000:1.0:1789776386.197653:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776386.197710:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471461888 00000100:00100000:1.0:1789776386.197718:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471461888 00000100:00100000:1.0:1789776386.197848:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789776386.197859:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af8c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3272:x1876716471461888:12345-0@lo:8: 00010000:00080000:1.0:1789776386.197899:0:6659:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 138 last 0 00000020:00000080:1.0:1789776386.197935:0:6659:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x26940258de8eef4d 00002000:00100000:1.0:1789776386.197986:0:6659:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9c86b641c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396f ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1789776386.197992:0:6659:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1789776386.197996:0:6659:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1789776386.198372:0:6659:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789776386.198890:0:6659:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789776386.198933:0:6659:0:(import.c:65:import_set_state_nolock()) ffff9c86b641e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789776386.199050:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af8c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3272:x1876716471461888:12345-0@lo:8: Request processed in 1190us (1633us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776386.199060:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789776386.199144:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c86aa654a80 x1876716471461888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789776396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776386.199157:0:3272:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789776386.199168:0:3272:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789776386.199178:0:3272:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789776386.199184:0:3272:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789776386.199187:0:3272:0:(import.c:65:import_set_state_nolock()) ffff9c86bc8e1000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789776386.199203:0:3272:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789776386.199210:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa654a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3272:1876716471461888:0@lo:8: 00000100:00100000:1.0:1789776386.199244:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471462016 00000100:00100000:1.0:1789776386.199248:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471462016 00000004:00080000:0.0:1789776386.199275:0:6754:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1789776386.199300:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471462144 00000100:00100000:1.0:1789776386.199303:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471462144 00000100:00100000:1.0:1789776386.199329:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789776386.199337:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa657100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1876716471462016:12345-0@lo:400: 00000100:00100000:1.0:1789776386.199384:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa657100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1876716471462016:12345-0@lo:400: Request processed in 48us (1970us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776386.199391:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789776386.199403:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789776386.199408:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa656a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1876716471462144:12345-0@lo:400: 00000004:00080000:0.0:1789776386.199436:0:6754:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 138979218664ns, next at 0ns, rc = 0 00000100:00100000:1.0:1789776386.199571:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa656a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1876716471462144:12345-0@lo:400: Request processed in 162us (1917us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776386.199578:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1789776386.199603:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789776386.199659:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c86aa655880 x1876716471462144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776386.199671:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa655880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3273:1876716471462144:0@lo:400: 00010000:00080000:1.0:1789776386.199683:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c86aa656300 x1876716471462016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776386.199691:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa656300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3273:1876716471462016:0@lo:400: 00000020:01000000:1.0:1789776386.200000:0:6752:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789776386.200075:0:6752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776386.200078:0:6752:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789776386.200083:0:6752:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789776386.200089:0:6752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776386.200091:0:6752:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789776386.200181:0:6752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789776386.200185:0:6752:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789776386.200261:0:6752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa656300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:6752:1876716471462272:0@lo:502: 00000100:00100000:1.0:1789776386.200341:0:6752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776386.200378:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471462272 00000100:00100000:1.0:1789776386.200382:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471462272 00000100:00100000:1.0:1789776386.200413:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789776386.205882:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8691427450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+15:6752:x1876716471462272:12345-0@lo:502: 00000100:00100000:1.0:1789776386.206349:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8691427450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+15:6752:x1876716471462272:12345-0@lo:502: Request processed in 531us (6005us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776386.206359:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789776386.206464:0:6752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86aa47d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776386.206497:0:6752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa656300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:6752:1876716471462272:0@lo:502: 00000020:01000000:1.0:1789776386.206542:0:6752:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789776386.206552:0:6752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776386.206555:0:6752:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789776386.206560:0:6752:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1789776386.206645:0:5808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1789776386.206667:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789776386.206680:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c86829e1a00/0x26940258de8eef2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eef31 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776386.206693:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c86829e1a00/0x26940258de8eef2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eef31 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776386.206705:0:5808:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789776386.206708:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c86aa63b370 from 1 10000000:01000000:1.0:1789776386.206711:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789776386.206748:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c86829e0800/0x26940258de8eef54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776386.206758:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c86829e0800/0x26940258de8eef54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776386.206777:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c86829e0800/0x26940258de8eef54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776386.206798:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa656300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471462400:0@lo:101: 00000100:00100000:1.0:1789776386.206844:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776386.206867:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86aa47d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776386.207091:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471462400 00000100:00100000:3.0:1789776386.207099:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471462400 00000100:00100000:3.0:1789776386.207159:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789776386.207168:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8691424c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+15:5808:x1876716471462400:12345-0@lo:101: 00010000:00010000:3.0:1789776386.207183:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776386.207201:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c8681679a00/0x26940258de8eef5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8eef54 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776386.207248:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c8681679a00/0x26940258de8eef5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8eef54 expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776386.207259:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c8681679a00/0x26940258de8eef5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8eef54 expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776386.207269:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8681679a00, rc 0) 00000100:00100000:3.0:1789776386.207309:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8691424c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+16:5808:x1876716471462400:12345-0@lo:101: Request processed in 142us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776386.207315:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789776386.207352:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa656300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471462400:0@lo:101: 00010000:00010000:3.0:1789776386.207366:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c86829e0800/0x26940258de8eef54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eef5b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776386.207375:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c86829e0800/0x26940258de8eef54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8eef5b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776386.207441:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb4f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471462528:0@lo:501: 00000100:00100000:3.0:1789776386.207468:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776386.207484:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86878f0480 going to sleep for 11 seconds 00000100:00100000:3.0:1789776386.207495:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471462528 00000100:00100000:3.0:1789776386.207506:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471462528 00000100:00100000:3.0:1789776386.207526:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789776386.207532:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8691424050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+16:5808:x1876716471462528:12345-0@lo:501: 00000100:00100000:3.0:1789776386.207790:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8691424050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+16:5808:x1876716471462528:12345-0@lo:501: Request processed in 257us (320us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789776386.207798:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789776386.208020:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb4f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471462528:0@lo:501: 10000000:01000000:1.0:1789776386.208043:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789776386.208050:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c86829e0800/0x26940258de8eef54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eef5b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776386.208058:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c86829e0800/0x26940258de8eef54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eef5b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789776386.241487:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:2.0:1789776386.271382:0:6755:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789776386.271449:0:6755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6755:1876716471462784:0@lo:7: 00000100:00100000:2.0:1789776386.271570:0:6755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776386.271642:0:6755:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86a00da000 going to sleep for 11 seconds 00000100:00100000:3.0:1789776386.271645:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471462656:0@lo:13: 00000100:00100000:3.0:1789776386.271687:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776386.271735:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471462656 00000100:00100000:2.0:1789776386.271745:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471462656 00000100:00100000:1.0:1789776386.271764:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471462784 00000100:00100000:1.0:1789776386.271769:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471462784 00000100:00100000:2.0:1789776386.271814:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789776386.271814:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789776386.271825:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3275:x1876716471462656:12345-0@lo:13: 00002000:00000024:2.0:1789776386.271868:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1789776386.271904:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:6755:x1876716471462784:12345-0@lo:7: 00000100:00100000:2.0:1789776386.271922:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3275:x1876716471462656:12345-0@lo:13: Request processed in 99us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776386.271936:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789776386.271987:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c86babc3480 x1876716471462656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776402 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776386.272011:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471462656:0@lo:13: 00000100:00080000:3.0:1789776386.272359:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:1.0:1789776386.284078:0:6662:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1789776386.284092:0:6662:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1789776386.284278:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6755:x1876716471462784:12345-0@lo:7: Request processed in 12368us (12701us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776386.284292:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789776386.284299:0:6755:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c86babc0a80 x1876716471462784/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789776402 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776386.284318:0:6755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6755:1876716471462784:0@lo:7: 00000004:00080000:2.0:1789776386.284338:0:6755:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789776386.284389:0:6755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6755:1876716471462912:0@lo:5: 00000100:00100000:2.0:1789776386.284446:0:6755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776386.284493:0:6755:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86a00da000 going to sleep for 11 seconds 00000100:00100000:1.0:1789776386.285317:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471462912 00000100:00100000:1.0:1789776386.285331:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471462912 00000100:00100000:1.0:1789776386.285455:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789776386.285490:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6755:x1876716471462912:12345-0@lo:5: 00002000:00080000:1.0:1789776386.285535:0:6659:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1789776386.285541:0:6659:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1789776386.286002:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6755:x1876716471462912:12345-0@lo:5: Request processed in 515us (1555us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789776386.286011:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789776386.286062:0:6755:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c86babc0a80 x1876716471462912/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789776402 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776386.286097:0:6755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6755:1876716471462912:0@lo:5: 00000004:00080000:2.0:1789776386.286295:0:6755:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789776386.286348:0:6755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6755:1876716471463040:0@lo:700: 00000100:00100000:2.0:1789776386.286390:0:6755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776386.286450:0:6755:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86a00da000 going to sleep for 11 seconds 00000100:00100000:3.0:1789776386.286508:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471463040 00000100:00100000:3.0:1789776386.286516:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471463040 00000100:00100000:3.0:1789776386.286561:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789776386.286570:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6755:x1876716471463040:12345-0@lo:700: 00000100:00100000:3.0:1789776386.286619:0:6668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb4f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6668:1876716471463168:0@lo:700: 00000100:00100000:3.0:1789776386.286661:0:6668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776386.286688:0:6668:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8691795180 going to sleep for 11 seconds 00000100:00100000:2.0:1789776386.286838:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471463168 00000100:00100000:2.0:1789776386.286842:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471463168 00000100:00100000:2.0:1789776386.286884:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789776386.286892:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6668:x1876716471463168:12345-0@lo:700: 40000000:02000000:3.0:1789776386.328544:0:5818:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1789776386.343855:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6668:x1876716471463168:12345-0@lo:700: Request processed in 56949us (57178us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776386.343957:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789776386.344068:0:6668:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c86bb4f3480 x1876716471463168/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789776402 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776386.344091:0:6668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb4f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6668:1876716471463168:0@lo:700: 40000000:02000000:0.0:1789776386.344110:0:6668:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:0.0:1789776386.527793:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1789776386.527825:0:6684:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789776386.527975:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6755:x1876716471463040:12345-0@lo:700: Request processed in 241399us (241577us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776386.527998:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789776386.528071:0:6755:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c86babc1880 x1876716471463040/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789776402 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776386.528085:0:6755:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789776386.529750:0:6755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6755:1876716471463040:0@lo:700: 00000004:02000040:0.0:1789776386.598301:0:6755:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1789776386.605016:0:6755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6755:1876716471463296:0@lo:5: 00000100:00100000:2.0:1789776386.605128:0:6755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776386.605250:0:6755:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86a00da000 going to sleep for 11 seconds 00000100:00100000:0.0:1789776386.605919:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471463296 00000100:00100000:0.0:1789776386.605942:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471463296 00000100:00100000:0.0:1789776386.609666:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789776386.609700:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6755:x1876716471463296:12345-0@lo:5: 00002000:00080000:2.0:1789776386.620169:0:6662:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1789776386.620205:0:6662:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1789776386.633912:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6755:x1876716471463296:12345-0@lo:5: Request processed in 24212us (28770us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789776386.633936:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789776386.635621:0:6755:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c86babc2a00 x1876716471463296/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789776402 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776386.635652:0:6755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6755:1876716471463296:0@lo:5: 00000004:00080000:2.0:1789776386.635676:0:6755:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:3.0:1789776386.965436:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776387.990100:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776389.012451:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776390.037776:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776391.060493:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776391.575394:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86af8c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471463808:0@lo:400: 00000100:00100000:0.0:1789776391.575470:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776391.575536:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789776391.575543:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86af8c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471463424:0@lo:400: 00000100:00100000:0.0:1789776391.575584:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776391.575620:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86af8c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3273:1876716471463552:0@lo:400: 00000100:00100000:0.0:1789776391.575646:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776391.575666:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789776391.575672:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86af8cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3273:1876716471463680:0@lo:400: 00000100:00100000:0.0:1789776391.575693:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776391.575742:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471463808 00000100:00100000:0.0:1789776391.575750:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471463808 00000100:00100000:0.0:1789776391.575806:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789776391.575816:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af8ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3275:x1876716471463808:12345-0@lo:400: 00000100:00100000:0.0:1789776391.575865:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af8ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3275:x1876716471463808:12345-0@lo:400: Request processed in 51us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776391.575872:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789776391.575896:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471463424 00000100:00100000:0.0:1789776391.575899:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471463424 00000100:00100000:0.0:1789776391.575922:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789776391.575927:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86c2071450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+16:3275:x1876716471463424:12345-0@lo:400: 00000100:00100000:0.0:1789776391.575953:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86c2071450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+16:3275:x1876716471463424:12345-0@lo:400: Request processed in 26us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776391.575959:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789776391.575997:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471463552 00000100:00100000:0.0:1789776391.576000:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471463552 00000100:00100000:0.0:1789776391.576021:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471463680 00000100:00100000:0.0:1789776391.576023:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471463680 00000100:00100000:0.0:1789776391.576036:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789776391.576042:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af8c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1876716471463552:12345-0@lo:400: 00000100:00100000:0.0:1789776391.576075:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af8c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1876716471463552:12345-0@lo:400: Request processed in 33us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776391.576081:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789776391.576093:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789776391.576099:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af8cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1876716471463680:12345-0@lo:400: 00000100:00100000:0.0:1789776391.576125:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af8cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1876716471463680:12345-0@lo:400: Request processed in 26us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776391.576130:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1789776391.576664:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789776391.576670:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789776391.576703:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86af8c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471463424:0@lo:400: 00010000:00080000:0.0:1789776391.576717:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c86af8c8a80 x1876716471463808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776391.576730:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86af8c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471463808:0@lo:400: 00010000:00080000:0.0:1789776391.576769:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c86af8cb480 x1876716471463680/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776391.576779:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86af8cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3273:1876716471463680:0@lo:400: 00010000:00080000:0.0:1789776391.576790:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c86af8c9180 x1876716471463552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776391.576798:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86af8c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3273:1876716471463552:0@lo:400: 00000100:00100000:1.0:1789776391.588298:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789776391.588327:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa655880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471463936:0@lo:13: 00000100:00100000:1.0:1789776391.588419:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776391.588505:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471463936 00000100:00100000:1.0:1789776391.588514:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471463936 00000100:00100000:1.0:1789776391.588577:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789776391.588587:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa656300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3275:x1876716471463936:12345-0@lo:13: 00002000:00000024:1.0:1789776391.588624:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789776391.588677:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa656300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3275:x1876716471463936:12345-0@lo:13: Request processed in 91us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776391.588685:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789776391.588727:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c86aa655880 x1876716471463936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776407 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776391.588746:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa655880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471463936:0@lo:13: 00000001:00080000:2.0:1789776391.676136:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:02000400:2.0:1789776391.704107:0:7030:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789776392.085630:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776393.108466:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776394.136523:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776395.159328:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776396.182721:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776396.694057:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9db43398-240e-4f78-8778-c11d527e09a1:3273:1876716471464064:0@lo:400: 00000100:00100000:0.0:1789776396.694133:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776396.694189:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789776396.694196:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3273:1876716471464192:0@lo:400: 00000100:00100000:0.0:1789776396.694244:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776396.694282:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471464192 00000100:00100000:0.0:1789776396.694289:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471464192 00000100:00100000:0.0:1789776396.694344:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789776396.694354:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af8c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1876716471464192:12345-0@lo:400: 00000100:00100000:0.0:1789776396.694419:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af8c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1876716471464192:12345-0@lo:400: Request processed in 67us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776396.694426:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789776396.694480:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c86babc0a80 x1876716471464192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776396.694493:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3273:1876716471464192:0@lo:400: 00000100:00100000:3.0:1789776396.695617:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471464064 00000100:00100000:3.0:1789776396.695628:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471464064 00000100:00100000:3.0:1789776396.695682:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789776396.695690:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+16:3273:x1876716471464064:12345-0@lo:400: 00000100:00100000:3.0:1789776396.695746:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+16:3273:x1876716471464064:12345-0@lo:400: Request processed in 57us (1612us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776396.695752:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789776396.695846:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9db43398-240e-4f78-8778-c11d527e09a1:3273:1876716471464064:0@lo:400: 00000100:00100000:3.0:1789776396.697963:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86af8cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471464448:0@lo:13: 00000100:00100000:3.0:1789776396.698034:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776396.698074:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789776396.698081:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3276:1876716471464320:0@lo:400: 00000100:00100000:3.0:1789776396.698109:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776396.698144:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471464448 00000100:00100000:3.0:1789776396.698150:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471464448 00000100:00100000:3.0:1789776396.698202:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789776396.698211:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471464448:12345-0@lo:13: 00002000:00000024:3.0:1789776396.698274:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789776396.698320:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471464448:12345-0@lo:13: Request processed in 110us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776396.698328:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789776396.698394:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c86af8cb480 x1876716471464448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776412 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776396.698407:0:3276:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789776396.698428:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86af8cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471464448:0@lo:13: 00000100:00080000:2.0:1789776396.704262:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789776396.704287:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471464320 00000100:00100000:2.0:1789776396.704298:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471464320 00000100:00100000:2.0:1789776396.704369:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789776396.704381:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876716471464320:12345-0@lo:400: 00000100:00100000:2.0:1789776396.704794:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876716471464320:12345-0@lo:400: Request processed in 415us (6683us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776396.704803:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1789776396.704827:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789776396.704857:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c86babc1c00 x1876716471464320/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776396.704872:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3276:1876716471464320:0@lo:400: 00010000:00010000:0.0:1789776397.204706:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776398.233228:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776399.253073:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776400.279336:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776401.305654:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776401.812516:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa655880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9db43398-240e-4f78-8778-c11d527e09a1:3273:1876716471464576:0@lo:400: 00000100:00100000:1.0:1789776401.812595:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776401.812652:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789776401.812659:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa654a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3273:1876716471464704:0@lo:400: 00000100:00100000:1.0:1789776401.812686:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776401.812718:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa655c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3275:1876716471464832:0@lo:400: 00000100:00100000:1.0:1789776401.812751:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776401.812785:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789776401.812791:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa656680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471464960:0@lo:400: 00000100:00100000:1.0:1789776401.812815:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776401.812852:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471464576 00000100:00100000:1.0:1789776401.812859:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471464576 00000100:00100000:1.0:1789776401.812914:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789776401.812923:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+16:3273:x1876716471464576:12345-0@lo:400: 00000100:00100000:1.0:1789776401.812971:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+16:3273:x1876716471464576:12345-0@lo:400: Request processed in 49us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776401.812979:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789776401.813012:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471464704 00000100:00100000:1.0:1789776401.813016:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471464704 00000100:00100000:1.0:1789776401.813039:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471464832 00000100:00100000:1.0:1789776401.813041:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471464832 00000100:00100000:1.0:1789776401.813066:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789776401.813089:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa655180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1876716471464704:12345-0@lo:400: 00000100:00100000:1.0:1789776401.813123:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa655180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1876716471464704:12345-0@lo:400: Request processed in 50us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776401.813129:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789776401.813142:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789776401.813149:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1876716471464832:12345-0@lo:400: 00000100:00100000:1.0:1789776401.813181:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1876716471464832:12345-0@lo:400: Request processed in 33us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776401.813186:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789776401.813207:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471464960 00000100:00100000:1.0:1789776401.813211:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471464960 00000100:00100000:1.0:1789776401.813270:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789776401.813276:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa654700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471464960:12345-0@lo:400: 00000100:00100000:1.0:1789776401.813335:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa654700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471464960:12345-0@lo:400: Request processed in 59us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776401.813341:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1789776401.813362:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789776401.813366:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789776401.813391:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c86aa656680 x1876716471464960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776401.813405:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa656680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471464960:0@lo:400: 00010000:00080000:0.0:1789776401.813688:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c86aa654a80 x1876716471464704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776401.813699:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa654a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3273:1876716471464704:0@lo:400: 00000100:00100000:0.0:1789776401.813708:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa655880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9db43398-240e-4f78-8778-c11d527e09a1:3273:1876716471464576:0@lo:400: 00010000:00080000:0.0:1789776401.814707:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c86aa655c00 x1876716471464832/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776401.814730:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa655c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3275:1876716471464832:0@lo:400: 00000100:00100000:1.0:1789776401.814880:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789776401.814893:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86af8c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471465088:0@lo:13: 00000100:00100000:1.0:1789776401.814941:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776401.815042:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471465088 00000100:00100000:0.0:1789776401.815048:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471465088 00000100:00100000:0.0:1789776401.815104:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789776401.815113:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa655500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471465088:12345-0@lo:13: 00002000:00000024:0.0:1789776401.815147:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789776401.815190:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa655500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471465088:12345-0@lo:13: Request processed in 79us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776401.815197:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789776401.815607:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c86af8c8a80 x1876716471465088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776417 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776401.815626:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86af8c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471465088:0@lo:13: 00010000:00010000:3.0:1789776402.324718:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776403.349044:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789776403.789787:0:7597:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789776403.789792:0:7597:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1789776403.790448:0:7597:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c86af31b000 00000020:01000004:3.0:1789776403.790537:0:7597:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789776403.790552:0:7597:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1789776403.790568:0:7597:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9c86b99019b8) 00000020:00000080:3.0:1789776403.790586:0:7597:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789776403.810418:0:7597:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1789776403.810808:0:7597:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789776403.844255:0:7597:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789776403.857069:0:7597:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789776403.857105:0:7597:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789776403.857164:0:7597:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789776403.857190:0:7597:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789776403.857594:0:7597:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789776403.857606:0:7597:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789776403.857619:0:7597:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x26940258de8eef69 00000020:01000004:3.0:1789776403.857626:0:7597:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1789776403.857647:0:7597:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.106@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789776403.857651:0:7597:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789776403.857656:0:7597:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789776403.857678:0:7597:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1789776403.857682:0:7597:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.106@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1789776403.899455:0:7597:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.106@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789776403.899493:0:7597:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.106@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1789776403.899498:0:7597:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789776403.899500:0:7597:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789776403.899502:0:7597:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789776403.899503:0:7597:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789776403.899504:0:7597:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789776403.899505:0:7597:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789776403.899507:0:7597:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789776403.899508:0:7597:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789776403.899510:0:7597:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789776403.899511:0:7597:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789776403.899513:0:7597:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789776403.899516:0:7597:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1789776403.899524:0:7597:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789776403.899525:0:7597:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789776403.899532:0:7597:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789776403.899533:0:7597:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789776403.899534:0:7597:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789776403.899535:0:7597:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789776403.899536:0:7597:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789776403.899536:0:7597:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789776403.899537:0:7597:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789776403.899538:0:7597:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789776403.899539:0:7597:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789776403.899567:0:7597:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789776403.899584:0:7597:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa654380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:7597:1876716471465216:0@lo:253: 00000100:00100000:1.0:1789776403.899655:0:7597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776403.899749:0:7597:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8691eedd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789776403.904453:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471465216 00000100:00100000:0.0:1789776403.904470:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471465216 00000100:00100000:1.0:1789776403.904696:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789776403.904708:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+16:7597:x1876716471465216:12345-0@lo:253: 20000000:01000000:1.0:1789776403.904763:0:5805:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789776403.904768:0:5805:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1789776403.904773:0:5805:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1789776403.904776:0:5805:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1789776403.907207:0:5805:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789776403.907710:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1789776403.907726:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1789776403.907768:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1789776403.907777:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1789776403.907809:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1789776403.907858:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1789776403.908685:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1789776403.908708:0:5805:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.106@tcp 20000000:01000000:1.0:1789776403.908711:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.106@tcp (null) (null) (null) 00000040:00080000:1.0:1789776403.908746:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1789776403.908753:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789776403.908801:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1789776403.908817:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.106@tcp (null) (null) 00000040:00080000:1.0:1789776403.908852:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1789776403.908861:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789776403.908892:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1789776403.909207:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1789776403.910800:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1789776403.910831:0:5805:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.106@tcp 20000000:01000000:1.0:1789776403.910834:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.106@tcp (null) (null) (null) 00000040:00080000:1.0:1789776403.910873:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1789776403.910882:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789776403.911140:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1789776403.911151:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.106@tcp (null) (null) 00000040:00080000:1.0:1789776403.911182:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1789776403.911190:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789776403.911302:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1789776403.911342:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1789776403.911357:0:5805:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789776403.911360:0:5805:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789776403.911364:0:5805:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789776403.911376:0:5805:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789776403.911378:0:5805:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789776403.911413:0:5805:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789776403.911415:0:5805:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789776403.913105:0:7599:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1789776403.913198:0:7599:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1789776403.913287:0:7599:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1789776403.913780:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1789776403.913827:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1789776403.913883:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1789776403.914130:0:5805:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789776403.914133:0:5805:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789776403.914863:0:7600:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1789776403.915173:0:7600:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1789776403.917759:0:7600:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1789776403.918211:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1789776403.918428:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1789776403.918686:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1789776403.918702:0:5805:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789776403.918718:0:5805:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789776403.919515:0:7601:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1789776403.919722:0:7601:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1789776403.919798:0:7601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1789776403.920119:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1789776403.920167:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1789776403.920203:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1789776403.920339:0:5805:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1789776403.920342:0:5805:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789776403.921877:0:7602:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1789776403.922202:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1789776403.922579:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1789776403.922659:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1789776403.922678:0:5805:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1789776403.922680:0:5805:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1789776403.922689:0:5805:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789776403.922709:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c86829e1800/0x26940258de8eef70 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776403.922728:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c8681679c00/0x26940258de8eeec1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8eeeba expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776403.922736:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c868afc7a00/0x26940258de8eeeeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8eeee4 expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776403.922742:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c86829e1000/0x26940258de8eef15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8eef0e expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776403.922748:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c8680030800/0x26940258de8eef31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8eef2a expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776403.922755:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c8681679a00/0x26940258de8eef5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8eef54 expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776403.922761:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c86829e1800/0x26940258de8eef70 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776403.922803:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c8681679a00/0x26940258de8eef5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26940258de8eef54 expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776403.922830:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c8681679a00/0x26940258de8eef5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26940258de8eef54 expref: 16 pid: 5804 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776403.922845:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa654000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5805:1876716471465344:0@lo:104: 00000100:00100000:1.0:1789776403.922912:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789776403.923016:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c8680030800/0x26940258de8eef31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26940258de8eef2a expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776403.923025:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c8680030800/0x26940258de8eef31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26940258de8eef2a expref: 16 pid: 5805 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776403.923034:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa657800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5805:1876716471465472:0@lo:104: 00010000:00010000:1.0:1789776403.923061:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c86829e1000/0x26940258de8eef15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26940258de8eef0e expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776403.923068:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c86829e1000/0x26940258de8eef15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26940258de8eef0e expref: 16 pid: 5806 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776403.923076:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa655f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5805:1876716471465600:0@lo:104: 00010000:00010000:1.0:1789776403.923098:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c868afc7a00/0x26940258de8eeeeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26940258de8eeee4 expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776403.923105:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c868afc7a00/0x26940258de8eeeeb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26940258de8eeee4 expref: 16 pid: 5804 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776403.923112:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa655c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5805:1876716471465728:0@lo:104: 00010000:00010000:1.0:1789776403.923134:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c8681679c00/0x26940258de8eeec1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26940258de8eeeba expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776403.923154:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c8681679c00/0x26940258de8eeec1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26940258de8eeeba expref: 16 pid: 5804 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776403.923162:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa656680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5805:1876716471465856:0@lo:104: 00000100:00100000:1.0:1789776403.923182:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8691eedf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789776403.926077:0:5794:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789776403.926126:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776403.926174:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776403.926184:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776403.926194:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776403.926209:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471465344 00000100:00100000:1.0:1789776403.926315:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471465472 00000100:00100000:1.0:1789776403.926324:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471465472 00000100:00100000:1.0:1789776403.926363:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471465600 00000100:00100000:1.0:1789776403.926366:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471465600 00000100:00100000:1.0:1789776403.926377:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471465728 00000100:00100000:1.0:1789776403.926379:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471465728 00000100:00100000:1.0:1789776403.926386:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471465856 00000100:00100000:1.0:1789776403.926388:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471465856 00000100:00100000:1.0:1789776403.926400:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789776403.926409:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9db43398-240e-4f78-8778-c11d527e09a1+6:5805:x1876716471465472:12345-0@lo:104: 00010000:00010000:1.0:1789776403.926426:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c86829e1a00/0x26940258de8eef2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8eef31 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776403.926561:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789776403.926567:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9db43398-240e-4f78-8778-c11d527e09a1+6:5805:x1876716471465472:12345-0@lo:104: Request processed in 160us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776403.926575:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789776403.926593:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789776403.926599:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9db43398-240e-4f78-8778-c11d527e09a1+5:5805:x1876716471465600:12345-0@lo:104: 00010000:00010000:1.0:1789776403.926607:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c8680031c00/0x26940258de8eef0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8eef15 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776403.926641:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789776403.926659:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9db43398-240e-4f78-8778-c11d527e09a1+5:5805:x1876716471465600:12345-0@lo:104: Request processed in 60us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776403.926665:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789776403.926678:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789776403.926684:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9db43398-240e-4f78-8778-c11d527e09a1+4:5805:x1876716471465728:12345-0@lo:104: 00010000:00010000:1.0:1789776403.926692:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c86829e0a00/0x26940258de8eeee4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8eeeeb expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776403.926720:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789776403.926725:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9db43398-240e-4f78-8778-c11d527e09a1+4:5805:x1876716471465728:12345-0@lo:104: Request processed in 43us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776403.926730:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789776403.926742:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789776403.926747:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9db43398-240e-4f78-8778-c11d527e09a1+3:5805:x1876716471465856:12345-0@lo:104: 00010000:00010000:1.0:1789776403.926754:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c868afc7400/0x26940258de8eeeba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8eeec1 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776403.926778:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789776403.926783:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9db43398-240e-4f78-8778-c11d527e09a1+3:5805:x1876716471465856:12345-0@lo:104: Request processed in 37us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776403.926788:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789776403.926959:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471465344 00000100:00100000:2.0:1789776403.926994:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789776403.927000:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8691ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9db43398-240e-4f78-8778-c11d527e09a1+3:5805:x1876716471465344:12345-0@lo:104: 00010000:00010000:2.0:1789776403.927008:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c86829e0800/0x26940258de8eef54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8eef5b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776403.927040:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1789776403.927045:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8691ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9db43398-240e-4f78-8778-c11d527e09a1+3:5805:x1876716471465344:12345-0@lo:104: Request processed in 46us (4134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776403.927057:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1789776403.927118:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789776403.927125:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c86829e1a00/0x26940258de8eef2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8eef31 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776403.927133:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86829e1a00 already unused, calling callback (ffffffffc1da0c20) 10000000:00010000:2.0:1789776403.927137:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c86829e1a00/0x26940258de8eef2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x26940258de8eef31 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776403.927145:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c86829e1a00/0x26940258de8eef2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x26940258de8eef31 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776403.927154:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c86829e1a00/0x26940258de8eef2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x26940258de8eef31 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776403.927160:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789776403.927191:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c86829e1a00/0x26940258de8eef2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eef31 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776403.927198:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789776403.927211:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c86829e1a00/0x26940258de8eef2a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eef31 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776403.927246:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c86829e1a00/0x26940258de8eef2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eef31 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776403.927259:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789776403.927262:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c8680031c00/0x26940258de8eef0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8eef15 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776403.927289:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8680031c00 already unused, calling callback (ffffffffc1da0c20) 10000000:00010000:2.0:1789776403.927292:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c8680031c00/0x26940258de8eef0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x26940258de8eef15 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776403.927299:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c8680031c00/0x26940258de8eef0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x26940258de8eef15 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776403.927305:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c8680031c00/0x26940258de8eef0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x26940258de8eef15 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776403.927311:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789776403.927325:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c8680031c00/0x26940258de8eef0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eef15 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776403.927331:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789776403.927352:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c8680031c00/0x26940258de8eef0e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eef15 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776403.927358:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c8680031c00/0x26940258de8eef0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eef15 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776403.927367:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789776403.927370:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c86829e0a00/0x26940258de8eeee4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8eeeeb expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776403.927374:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86829e0a00 already unused, calling callback (ffffffffc1da0c20) 10000000:00010000:2.0:1789776403.927377:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c86829e0a00/0x26940258de8eeee4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x26940258de8eeeeb expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776403.927395:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c86829e0a00/0x26940258de8eeee4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x26940258de8eeeeb expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776403.927402:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c86829e0a00/0x26940258de8eeee4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x26940258de8eeeeb expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776403.927407:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789776403.927420:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c86829e0a00/0x26940258de8eeee4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eeeeb expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776403.927425:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789776403.927430:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c86829e0a00/0x26940258de8eeee4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eeeeb expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776403.927436:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c86829e0a00/0x26940258de8eeee4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eeeeb expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776403.927445:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789776403.927517:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c868afc7400/0x26940258de8eeeba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8eeec1 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776403.927524:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc7400 already unused, calling callback (ffffffffc1da0c20) 10000000:00010000:2.0:1789776403.927571:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c868afc7400/0x26940258de8eeeba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x26940258de8eeec1 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776403.927580:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c868afc7400/0x26940258de8eeeba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x26940258de8eeec1 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776403.927587:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c868afc7400/0x26940258de8eeeba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x26940258de8eeec1 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776403.927599:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789776403.927615:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c868afc7400/0x26940258de8eeeba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eeec1 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776403.927621:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789776403.927626:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c868afc7400/0x26940258de8eeeba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eeec1 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776403.927633:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c868afc7400/0x26940258de8eeeba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eeec1 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776403.927643:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776403.927646:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c86829e0800/0x26940258de8eef54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8eef5b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776403.927652:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86829e0800 already unused, calling callback (ffffffffc1da0c20) 10000000:00010000:2.0:1789776403.927655:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c86829e0800/0x26940258de8eef54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26940258de8eef5b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776403.927661:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c86829e0800/0x26940258de8eef54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26940258de8eef5b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776403.927666:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c86829e0800/0x26940258de8eef54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26940258de8eef5b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776403.927671:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789776403.927681:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c86829e0800/0x26940258de8eef54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eef5b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776403.927686:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789776403.927695:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c86829e0800/0x26940258de8eef54 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eef5b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776403.927702:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c86829e0800/0x26940258de8eef54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eef5b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776403.927716:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776403.927718:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776403.927719:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776403.927737:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776403.929345:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9db43398-240e-4f78-8778-c11d527e09a1:3274:1876716471465984:0@lo:103: 00000100:00100000:1.0:1789776403.929411:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776403.929515:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9db43398-240e-4f78-8778-c11d527e09a1:3274:1876716471466496:0@lo:103: 00000100:00100000:1.0:1789776403.929546:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776403.929578:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789776403.929585:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9db43398-240e-4f78-8778-c11d527e09a1:3274:1876716471466368:0@lo:103: 00000100:00100000:1.0:1789776403.929621:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776403.929652:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9db43398-240e-4f78-8778-c11d527e09a1:3276:1876716471466240:0@lo:103: 00000100:00100000:1.0:1789776403.929689:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776403.929705:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789776403.929711:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9db43398-240e-4f78-8778-c11d527e09a1:3276:1876716471466112:0@lo:103: 00000100:00100000:1.0:1789776403.929731:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776403.929754:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471465984 00000100:00100000:1.0:1789776403.929761:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471465984 00010000:00010000:1.0:1789776403.929804:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c8680030800/0x26940258de8eef31 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8eef2a expref: 17 pid: 5805 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776403.929826:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471466496 00000100:00100000:1.0:1789776403.929829:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471466496 00010000:00010000:1.0:1789776403.929840:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c8681679a00/0x26940258de8eef5b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8eef54 expref: 18 pid: 5804 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776403.929851:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471466368 00000100:00100000:1.0:1789776403.929854:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471466368 00010000:00010000:1.0:1789776403.929864:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c8681679c00/0x26940258de8eeec1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8eeeba expref: 19 pid: 5804 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776403.929874:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471466240 00000100:00100000:1.0:1789776403.929876:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471466240 00010000:00010000:1.0:1789776403.929886:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c868afc7a00/0x26940258de8eeeeb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8eeee4 expref: 20 pid: 5804 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776403.929895:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471466112 00000100:00100000:1.0:1789776403.929897:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471466112 00010000:00010000:1.0:1789776403.929907:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c86829e1000/0x26940258de8eef15 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8eef0e expref: 21 pid: 5806 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776403.929932:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789776403.929940:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa655880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9db43398-240e-4f78-8778-c11d527e09a1+21:3274:x1876716471465984:12345-0@lo:103: 00010000:00010000:1.0:1789776403.929954:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776403.929959:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c8680030800/0x26940258de8eef31 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8eef2a expref: 21 pid: 5805 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776403.929971:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c8680030800/0x26940258de8eef31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26940258de8eef2a expref: 21 pid: 5805 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776403.929992:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776403.930027:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa655880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9db43398-240e-4f78-8778-c11d527e09a1+21:3274:x1876716471465984:12345-0@lo:103: Request processed in 88us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776403.930035:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789776403.930050:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789776403.930056:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa654a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9db43398-240e-4f78-8778-c11d527e09a1+20:3274:x1876716471466496:12345-0@lo:103: 00010000:00010000:1.0:1789776403.930063:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776403.930068:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c8681679a00/0x26940258de8eef5b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8eef54 expref: 20 pid: 5804 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776403.930076:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c8681679a00/0x26940258de8eef5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26940258de8eef54 expref: 20 pid: 5804 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776403.930086:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776403.930107:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa654a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9db43398-240e-4f78-8778-c11d527e09a1+20:3274:x1876716471466496:12345-0@lo:103: Request processed in 52us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776403.930113:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789776403.930125:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789776403.930137:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa657480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9db43398-240e-4f78-8778-c11d527e09a1+19:3274:x1876716471466368:12345-0@lo:103: 00010000:00010000:1.0:1789776403.930145:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776403.930149:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c8681679c00/0x26940258de8eeec1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8eeeba expref: 19 pid: 5804 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776403.930157:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c8681679c00/0x26940258de8eeec1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26940258de8eeeba expref: 19 pid: 5804 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776403.930166:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776403.930187:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa657480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9db43398-240e-4f78-8778-c11d527e09a1+19:3274:x1876716471466368:12345-0@lo:103: Request processed in 51us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776403.930192:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789776403.930203:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789776403.930208:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba3bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9db43398-240e-4f78-8778-c11d527e09a1+18:3276:x1876716471466240:12345-0@lo:103: 00010000:00010000:1.0:1789776403.930240:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776403.930244:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c868afc7a00/0x26940258de8eeeeb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8eeee4 expref: 18 pid: 5804 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776403.930252:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c868afc7a00/0x26940258de8eeeeb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26940258de8eeee4 expref: 18 pid: 5804 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776403.930260:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776403.930298:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba3bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9db43398-240e-4f78-8778-c11d527e09a1+18:3276:x1876716471466240:12345-0@lo:103: Request processed in 90us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776403.930304:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789776403.930316:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789776403.930322:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba3bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9db43398-240e-4f78-8778-c11d527e09a1+17:3276:x1876716471466112:12345-0@lo:103: 00010000:00010000:1.0:1789776403.930329:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776403.930340:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c86829e1000/0x26940258de8eef15 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8eef0e expref: 17 pid: 5806 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776403.930348:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c86829e1000/0x26940258de8eef15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26940258de8eef0e expref: 17 pid: 5806 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776403.930359:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c86829e1800/0x26940258de8eef70 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776403.930367:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c86829e1800/0x26940258de8eef70 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776403.930382:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c86829e1800/0x26940258de8eef70 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776403.930388:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c86829e1800/0x26940258de8eef70 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776403.930395:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c86829e1800/0x26940258de8eef70 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776403.930402:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c86829e1800/0x26940258de8eef70 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776403.930407:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86829e1800 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:1.0:1789776403.930411:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c86829e1800/0x26940258de8eef70 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776403.930419:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c86829e1800/0x26940258de8eef70 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776403.930429:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c86829e1800/0x26940258de8eef70 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776403.930448:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776403.930699:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9db43398-240e-4f78-8778-c11d527e09a1:3274:1876716471466368:0@lo:103: 00000100:00100000:2.0:1789776403.930709:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9db43398-240e-4f78-8778-c11d527e09a1:3274:1876716471465984:0@lo:103: 00000100:00100000:2.0:1789776403.930716:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9db43398-240e-4f78-8778-c11d527e09a1:3274:1876716471466496:0@lo:103: 00000100:00100000:2.0:1789776403.930774:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9db43398-240e-4f78-8778-c11d527e09a1:3276:1876716471466240:0@lo:103: 00010000:00010000:0.0:1789776403.930950:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c8680030800/0x26940258de8eef31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26940258de8eef2a expref: 17 pid: 5805 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776403.930964:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa657800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5805:1876716471465472:0@lo:104: 00010000:00010000:0.0:1789776403.930976:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c86829e1000/0x26940258de8eef15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26940258de8eef0e expref: 16 pid: 5806 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776403.930984:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa655f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5805:1876716471465600:0@lo:104: 00010000:00010000:0.0:1789776403.930992:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c868afc7a00/0x26940258de8eeeeb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26940258de8eeee4 expref: 15 pid: 5804 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776403.931012:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa655c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5805:1876716471465728:0@lo:104: 00010000:00010000:0.0:1789776403.931025:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c8681679c00/0x26940258de8eeec1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26940258de8eeeba expref: 14 pid: 5804 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776403.931034:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa656680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5805:1876716471465856:0@lo:104: 00010000:00010000:0.0:1789776403.931044:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c8681679a00/0x26940258de8eef5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26940258de8eef54 expref: 13 pid: 5804 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776403.931051:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa654000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5805:1876716471465344:0@lo:104: 00010000:00010000:0.0:1789776403.931070:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c86829e1800/0x26940258de8eef70 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776403.931079:0:5805:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c86829e1800/0x26940258de8eef70 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776403.931085:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c86829e1800/0x26940258de8eef70 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776403.931090:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c86829e1800/0x26940258de8eef70 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789776403.931104:0:5805:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1789776403.932142:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba3bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9db43398-240e-4f78-8778-c11d527e09a1+12:3276:x1876716471466112:12345-0@lo:103: Request processed in 1817us (2406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776403.932152:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789776403.932195:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9db43398-240e-4f78-8778-c11d527e09a1:3276:1876716471466112:0@lo:103: 00000100:00100000:3.0:1789776404.002196:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+11:7597:x1876716471465216:12345-0@lo:253: Request processed in 97480us (102530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776404.002259:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789776404.002329:0:7597:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa654380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:7597:1876716471465216:0@lo:253: 10000000:01000000:3.0:1789776404.002343:0:7597:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789776404.002346:0:7597:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789776404.002348:0:7597:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789776404.002349:0:7597:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789776404.002351:0:7597:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1789776404.002352:0:7597:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789776404.002353:0:7597:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789776404.002354:0:7597:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789776404.002356:0:7597:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789776404.002357:0:7597:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789776404.002358:0:7597:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789776404.002377:0:7597:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c86af31b000 from lustre-OST0001 10000000:01000000:3.0:1789776404.002401:0:7597:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789776404.002404:0:7597:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789776404.002411:0:7597:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c86aa63b370 local copy 10000000:01000000:3.0:1789776404.002415:0:7597:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789776404.002465:0:7597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8681679800/0x26940258de8eef77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776404.002476:0:7597:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.106@tcp lock: ffff9c8681679800/0x26940258de8eef77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776404.002485:0:7597:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c8681679800/0x26940258de8eef77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776404.002503:0:7597:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb4f3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:7597:1876716471466624:0@lo:101: 00000100:00100000:3.0:1789776404.002687:0:7597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776404.002738:0:7597:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8687ef7180 going to sleep for 11 seconds 00000100:00100000:3.0:1789776404.002767:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471466624 00000100:00100000:3.0:1789776404.002779:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471466624 00000100:00100000:3.0:1789776404.002822:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789776404.002831:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+11:7597:x1876716471466624:12345-0@lo:101: 00010000:00010000:3.0:1789776404.002843:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776404.002855:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c8681679200/0x26940258de8eef7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8eef77 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776404.002879:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c8681679200/0x26940258de8eef7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8eef77 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776404.002890:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c8681679200/0x26940258de8eef7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8eef77 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776404.002899:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8681679200, rc 0) 00000100:00100000:3.0:1789776404.002930:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+12:7597:x1876716471466624:12345-0@lo:101: Request processed in 100us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776404.002936:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789776404.002968:0:7597:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb4f3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:7597:1876716471466624:0@lo:101: 00010000:00010000:3.0:1789776404.002981:0:7597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c8681679800/0x26940258de8eef77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x26940258de8eef7e expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776404.002989:0:7597:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c8681679800/0x26940258de8eef77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x26940258de8eef7e expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776404.003095:0:7597:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb4f3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:7597:1876716471466752:0@lo:501: 00000100:00100000:3.0:1789776404.003121:0:7597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776404.003134:0:7597:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8687ef7180 going to sleep for 11 seconds 00000100:00100000:3.0:1789776404.003147:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471466752 00000100:00100000:3.0:1789776404.003150:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471466752 00000100:00100000:3.0:1789776404.003175:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789776404.003180:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+12:7597:x1876716471466752:12345-0@lo:501: 00000100:00100000:3.0:1789776404.003394:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+12:7597:x1876716471466752:12345-0@lo:501: Request processed in 213us (271us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789776404.003401:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789776404.003430:0:7597:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb4f3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:7597:1876716471466752:0@lo:501: 10000000:01000000:3.0:1789776404.003442:0:7597:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789776404.003467:0:7597:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789776404.003472:0:7597:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8681679800/0x26940258de8eef77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x26940258de8eef7e expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776404.003480:0:7597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8681679800/0x26940258de8eef77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x26940258de8eef7e expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776404.003487:0:7597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9c8681679800/0x26940258de8eef77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x26940258de8eef7e expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776404.003502:0:7597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789776404.004840:0:7597:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c86af31b000 10000000:01000000:3.0:1789776404.004851:0:7597:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789776404.004856:0:7597:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789776404.004859:0:7597:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789776404.004863:0:7597:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789776404.004866:0:7597:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789776404.004893:0:7597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8681679000/0x26940258de8eef85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776404.004902:0:7597:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c8681679000/0x26940258de8eef85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776404.004928:0:7597:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c8681679000/0x26940258de8eef85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776404.004947:0:7597:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb4f3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:7597:1876716471466880:0@lo:101: 00000100:00100000:3.0:1789776404.004994:0:7597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789776404.005077:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776404.005084:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c8681679800/0x26940258de8eef77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x26940258de8eef7e expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776404.005091:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681679800 already unused, calling callback (ffffffffc1da0c20) 10000000:00010000:2.0:1789776404.005095:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c8681679800/0x26940258de8eef77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x26940258de8eef7e expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776404.005105:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c8681679800/0x26940258de8eef77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x26940258de8eef7e expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776404.005112:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c8681679800/0x26940258de8eef77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x26940258de8eef7e expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776404.005118:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789776404.005144:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c8681679800/0x26940258de8eef77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x26940258de8eef7e expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776404.005151:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789776404.005179:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c8681679800/0x26940258de8eef77 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x26940258de8eef7e expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776404.005186:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c8681679800/0x26940258de8eef77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x26940258de8eef7e expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776404.005198:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776404.005199:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776404.005201:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776404.005208:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789776404.005245:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9db43398-240e-4f78-8778-c11d527e09a1:3276:1876716471467008:0@lo:103: 00000100:00100000:2.0:1789776404.005283:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776404.005332:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471467008 00000100:00100000:2.0:1789776404.005338:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471467008 00000100:00100000:2.0:1789776404.005369:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789776404.005376:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9db43398-240e-4f78-8778-c11d527e09a1+12:3276:x1876716471467008:12345-0@lo:103: 00010000:00010000:2.0:1789776404.005386:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776404.005399:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c8681679200/0x26940258de8eef7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26940258de8eef77 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776404.005413:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776404.005437:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9db43398-240e-4f78-8778-c11d527e09a1+11:3276:x1876716471467008:12345-0@lo:103: Request processed in 61us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776404.005459:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789776404.005505:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9db43398-240e-4f78-8778-c11d527e09a1:3276:1876716471467008:0@lo:103: 00000100:00100000:3.0:1789776404.005675:0:7597:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8687ef7900 going to sleep for 11 seconds 00000100:00100000:0.0:1789776404.008078:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471466880 00000100:00100000:0.0:1789776404.008092:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471466880 00000100:00100000:2.0:1789776404.008269:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789776404.008307:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+11:7597:x1876716471466880:12345-0@lo:101: 00010000:00010000:2.0:1789776404.008325:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776404.008347:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c868afc7400/0x26940258de8eef8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8eef85 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776404.008377:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c868afc7400/0x26940258de8eef8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8eef85 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776404.008388:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c868afc7400/0x26940258de8eef8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8eef85 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776404.008397:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c868afc7400, rc 0) 00000100:00100000:2.0:1789776404.008800:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+12:7597:x1876716471466880:12345-0@lo:101: Request processed in 495us (3806us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776404.008808:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789776404.008912:0:7597:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb4f3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:7597:1876716471466880:0@lo:101: 00010000:00010000:1.0:1789776404.008931:0:7597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c8681679000/0x26940258de8eef85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eef8c expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776404.008941:0:7597:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c8681679000/0x26940258de8eef85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8eef8c expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776404.009069:0:7597:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:7597:1876716471467136:0@lo:501: 00000100:00100000:1.0:1789776404.009107:0:7597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776404.009147:0:7597:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86a002a600 going to sleep for 11 seconds 00000100:00100000:0.0:1789776404.009210:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471467136 00000100:00100000:0.0:1789776404.009240:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471467136 00000100:00100000:0.0:1789776404.009289:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789776404.009298:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+12:7597:x1876716471467136:12345-0@lo:501: 00000100:00100000:0.0:1789776404.010074:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+12:7597:x1876716471467136:12345-0@lo:501: Request processed in 774us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776404.010082:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789776404.010247:0:7597:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:7597:1876716471467136:0@lo:501: 00000100:00100000:1.0:1789776404.010314:0:7597:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:7597:1876716471467264:0@lo:503: 00000100:00100000:1.0:1789776404.010355:0:7597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776404.010387:0:7597:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86a002a600 going to sleep for 11 seconds 00000100:00100000:1.0:1789776404.010403:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471467264 00000100:00100000:1.0:1789776404.010408:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471467264 00000100:00100000:1.0:1789776404.010432:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789776404.010440:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+12:7597:x1876716471467264:12345-0@lo:503: 00000100:00100000:1.0:1789776404.010628:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+12:7597:x1876716471467264:12345-0@lo:503: Request processed in 188us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776404.010644:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789776404.010785:0:7597:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:7597:1876716471467264:0@lo:503: 00000040:00080000:3.0:1789776404.011045:0:7597:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789776404.011101:0:7597:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb4f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:7597:1876716471467392:0@lo:502: 00000100:00100000:3.0:1789776404.011142:0:7597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776404.011166:0:7597:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8687ef7900 going to sleep for 11 seconds 00000100:00100000:1.0:1789776404.011396:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471467392 00000100:00100000:1.0:1789776404.011402:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471467392 00000100:00100000:1.0:1789776404.011424:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789776404.011431:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+12:7597:x1876716471467392:12345-0@lo:502: 00000100:00100000:1.0:1789776404.011715:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+12:7597:x1876716471467392:12345-0@lo:502: Request processed in 283us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776404.011722:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789776404.012007:0:7597:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb4f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:7597:1876716471467392:0@lo:502: 00000040:00080000:3.0:1789776404.012338:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789776404.012391:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789776404.012419:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789776404.012490:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789776404.012826:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789776404.012867:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789776404.012900:0:7597:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb4f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:7597:1876716471467520:0@lo:502: 00000100:00100000:3.0:1789776404.012964:0:7597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776404.013002:0:7597:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8687ef7900 going to sleep for 11 seconds 00000100:00100000:0.0:1789776404.013143:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471467520 00000100:00100000:0.0:1789776404.013150:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471467520 00000100:00100000:0.0:1789776404.013194:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789776404.013203:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+12:7597:x1876716471467520:12345-0@lo:502: 00000100:00100000:0.0:1789776404.013410:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+12:7597:x1876716471467520:12345-0@lo:502: Request processed in 208us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776404.013418:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789776404.013919:0:7597:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb4f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:7597:1876716471467520:0@lo:502: 00000040:00080000:3.0:1789776404.014067:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1789776404.014080:0:7597:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1789776404.021183:0:7606:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789776404.021196:0:7606:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1789776404.021204:0:7606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776404.021207:0:7606:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789776404.022147:0:7606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789776404.022168:0:7606:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9c86bab63370) 00000020:00000080:1.0:1789776404.022193:0:7606:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789776404.022203:0:7606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789776404.022368:0:7606:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c86af31b000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789776404.022377:0:7606:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789776404.022385:0:7606:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x26940258de8eef9a 00010000:00010000:1.0:1789776404.028438:0:7606:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1789776404.029556:0:7606:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1789776404.035121:0:7606:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789776404.036428:0:7606:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1789776404.045844:0:7606:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1789776404.046600:0:7606:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1789776404.048507:0:7606:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789776404.048519:0:7606:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789776404.048526:0:7606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776404.048529:0:7606:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789776404.048532:0:7606:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789776404.048536:0:7606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776404.048537:0:7606:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789776404.048540:0:7606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789776404.048542:0:7606:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789776404.048595:0:7606:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789776404.048599:0:7606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776404.048600:0:7606:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789776404.048604:0:7606:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789776404.048775:0:7597:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1789776404.048805:0:7597:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789776404.048833:0:7597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8681679000/0x26940258de8eef85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eef8c expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776404.048846:0:7597:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c8681679000/0x26940258de8eef85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eef8c expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776404.048855:0:7597:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c86af31b000 from 1 10000000:01000000:3.0:1789776404.048858:0:7597:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789776404.048894:0:7597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8681679400/0x26940258de8eefa1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776404.048902:0:7597:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c8681679400/0x26940258de8eefa1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776404.048912:0:7597:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c8681679400/0x26940258de8eefa1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776404.048946:0:7597:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb4f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:7597:1876716471467648:0@lo:101: 00000100:00100000:3.0:1789776404.049025:0:7597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776404.049070:0:7597:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8687ef7900 going to sleep for 11 seconds 00000100:00100000:2.0:1789776404.049430:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471467648 00000100:00100000:2.0:1789776404.049438:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471467648 00000100:00100000:2.0:1789776404.049536:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789776404.049554:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+12:7597:x1876716471467648:12345-0@lo:101: 00010000:00010000:2.0:1789776404.049569:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776404.049584:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c868afc6a00/0x26940258de8eefa8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8eefa1 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776404.049609:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c868afc6a00/0x26940258de8eefa8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8eefa1 expref: 13 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776404.049619:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c868afc6a00/0x26940258de8eefa8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8eefa1 expref: 13 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776404.049628:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c868afc6a00, rc 0) 00000100:00100000:2.0:1789776404.049679:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+13:7597:x1876716471467648:12345-0@lo:101: Request processed in 127us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776404.049687:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789776404.049759:0:7597:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb4f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:7597:1876716471467648:0@lo:101: 00010000:00010000:3.0:1789776404.049775:0:7597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c8681679400/0x26940258de8eefa1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eefa8 expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776404.049784:0:7597:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c8681679400/0x26940258de8eefa1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8eefa8 expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776404.049880:0:7597:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb4f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:7597:1876716471467776:0@lo:501: 00000100:00100000:3.0:1789776404.049908:0:7597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776404.059349:0:7597:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8687ef7900 going to sleep for 11 seconds 00000100:00100000:1.0:1789776404.063097:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471467776 00000100:00100000:1.0:1789776404.063111:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471467776 00000100:00100000:1.0:1789776404.063167:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789776404.063176:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+13:7597:x1876716471467776:12345-0@lo:501: 00000100:00100000:1.0:1789776404.063528:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+13:7597:x1876716471467776:12345-0@lo:501: Request processed in 352us (13618us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776404.063536:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789776404.063709:0:7597:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb4f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:7597:1876716471467776:0@lo:501: 00000100:00100000:3.0:1789776404.063757:0:7597:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb4f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:7597:1876716471467904:0@lo:503: 00000100:00100000:3.0:1789776404.063805:0:7597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776404.063842:0:7597:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8687ef7900 going to sleep for 11 seconds 00000100:00100000:0.0:1789776404.064678:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471467904 00000100:00100000:0.0:1789776404.064686:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471467904 00000100:00100000:0.0:1789776404.064730:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789776404.064738:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+13:7597:x1876716471467904:12345-0@lo:503: 00000100:00100000:0.0:1789776404.065326:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+13:7597:x1876716471467904:12345-0@lo:503: Request processed in 588us (1520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776404.065334:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789776404.065441:0:7597:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb4f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:7597:1876716471467904:0@lo:503: 00000040:00080000:1.0:1789776404.065876:0:7597:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789776404.069261:0:7597:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:7597:1876716471468032:0@lo:502: 00000100:00100000:1.0:1789776404.069391:0:7597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776404.069443:0:7597:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86866bd9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776404.069678:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471468032 00000100:00100000:0.0:1789776404.069688:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471468032 00000100:00100000:0.0:1789776404.069748:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789776404.069759:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+13:7597:x1876716471468032:12345-0@lo:502: 00000100:00100000:0.0:1789776404.070033:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+13:7597:x1876716471468032:12345-0@lo:502: Request processed in 276us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776404.070041:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789776404.071114:0:7597:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:7597:1876716471468032:0@lo:502: 00000040:00080000:1.0:1789776404.071435:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789776404.071568:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789776404.071605:0:7597:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:7597:1876716471468160:0@lo:502: 00000100:00100000:1.0:1789776404.071662:0:7597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776404.071689:0:7597:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c869868f000 going to sleep for 11 seconds 00000100:00100000:1.0:1789776404.071709:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471468160 00000100:00100000:1.0:1789776404.071714:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471468160 00000100:00100000:1.0:1789776404.071742:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789776404.071750:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+13:7597:x1876716471468160:12345-0@lo:502: 00000100:00100000:1.0:1789776404.071899:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+13:7597:x1876716471468160:12345-0@lo:502: Request processed in 148us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776404.071906:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789776404.072364:0:7597:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:7597:1876716471468160:0@lo:502: 00000040:00080000:0.0:1789776404.072474:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1789776404.072490:0:7597:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1789776404.079362:0:7610:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789776404.079376:0:7610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776404.079378:0:7610:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789776404.079386:0:7610:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c86af31b000 00000020:00000080:0.0:1789776404.079388:0:7610:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789776404.079402:0:7610:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789776404.079405:0:7610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776404.079406:0:7610:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789776404.079409:0:7610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1789776404.081465:0:7597:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789776404.081507:0:7597:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789776404.081571:0:7597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8681679400/0x26940258de8eefa1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eefa8 expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776404.081603:0:7597:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c8681679400/0x26940258de8eefa1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eefa8 expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776404.081656:0:7597:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789776404.081658:0:7597:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c86af31b000 10000000:01000000:1.0:1789776404.081661:0:7597:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c86af31b000 10000000:01000000:1.0:1789776404.081665:0:7597:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789776404.081671:0:7597:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c86af31b000 from 1 10000000:01000000:1.0:1789776404.081673:0:7597:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789776404.081709:0:7597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c86829e1200/0x26940258de8eefaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776404.081717:0:7597:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c86829e1200/0x26940258de8eefaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776404.081728:0:7597:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c86829e1200/0x26940258de8eefaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776404.081749:0:7597:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:7597:1876716471468288:0@lo:101: 00000100:00100000:1.0:1789776404.081812:0:7597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776404.081881:0:7597:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86915d7300 going to sleep for 11 seconds 00000100:00100000:0.0:1789776404.082130:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471468288 00000100:00100000:0.0:1789776404.082137:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471468288 00000100:00100000:0.0:1789776404.082243:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789776404.082253:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+13:7597:x1876716471468288:12345-0@lo:101: 00010000:00010000:0.0:1789776404.082266:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776404.082289:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c8680030800/0x26940258de8eefb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8eefaf expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776404.082315:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c8680030800/0x26940258de8eefb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8eefaf expref: 14 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776404.082324:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c8680030800/0x26940258de8eefb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8eefaf expref: 14 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776404.082334:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8680030800, rc 0) 00000100:00100000:0.0:1789776404.082382:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+14:7597:x1876716471468288:12345-0@lo:101: Request processed in 130us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776404.082388:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789776404.082485:0:7597:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:7597:1876716471468288:0@lo:101: 00010000:00010000:2.0:1789776404.082501:0:7597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c86829e1200/0x26940258de8eefaf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eefb6 expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776404.082510:0:7597:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c86829e1200/0x26940258de8eefaf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8eefb6 expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776404.082612:0:7597:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:7597:1876716471468416:0@lo:501: 00000100:00100000:2.0:1789776404.082638:0:7597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776404.087687:0:7597:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf22bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789776404.087735:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471468416 00000100:00100000:1.0:1789776404.087746:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471468416 00000100:00100000:1.0:1789776404.087802:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789776404.087813:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+14:7597:x1876716471468416:12345-0@lo:501: 00000100:00100000:1.0:1789776404.088593:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+14:7597:x1876716471468416:12345-0@lo:501: Request processed in 779us (5950us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776404.088602:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789776404.088726:0:7597:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:7597:1876716471468416:0@lo:501: 00000100:00100000:2.0:1789776404.088776:0:7597:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:7597:1876716471468544:0@lo:503: 00000100:00100000:2.0:1789776404.088831:0:7597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776404.088861:0:7597:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf22bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789776404.089031:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471468544 00000100:00100000:1.0:1789776404.089035:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471468544 00000100:00100000:1.0:1789776404.089059:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789776404.089065:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+14:7597:x1876716471468544:12345-0@lo:503: 00000100:00100000:1.0:1789776404.089290:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+14:7597:x1876716471468544:12345-0@lo:503: Request processed in 224us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776404.089297:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789776404.089522:0:7597:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:7597:1876716471468544:0@lo:503: 00000040:00080000:2.0:1789776404.089799:0:7597:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789776404.089859:0:7597:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:7597:1876716471468672:0@lo:502: 00000100:00100000:2.0:1789776404.089895:0:7597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776404.089915:0:7597:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf22bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789776404.090062:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471468672 00000100:00100000:1.0:1789776404.090067:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471468672 00000100:00100000:1.0:1789776404.090103:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789776404.090110:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+14:7597:x1876716471468672:12345-0@lo:502: 00000100:00100000:1.0:1789776404.090302:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+14:7597:x1876716471468672:12345-0@lo:502: Request processed in 193us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776404.090309:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789776404.090434:0:7597:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:7597:1876716471468672:0@lo:502: 00000040:00080000:2.0:1789776404.090860:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789776404.090906:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789776404.091182:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789776404.091291:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789776404.091333:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789776404.091378:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789776404.091410:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789776404.091443:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789776404.102288:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789776404.102340:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789776404.102374:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789776404.102462:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789776404.102503:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789776404.102539:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789776404.102588:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789776404.102642:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789776404.102680:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789776404.102729:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789776404.102762:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789776404.102796:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789776404.102845:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789776404.102894:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789776404.103183:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789776404.103791:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789776404.103840:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1789776404.103873:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1789776404.104082:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1789776404.104129:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1789776404.104179:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1789776404.104262:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1789776404.104317:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1789776404.104349:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1789776404.104385:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1789776404.104547:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1789776404.104592:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1789776404.104641:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1789776404.104678:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1789776404.104734:0:7597:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:7597:1876716471468800:0@lo:502: 00000100:00100000:2.0:1789776404.104810:0:7597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776404.104849:0:7597:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf22b480 going to sleep for 11 seconds 00000100:00100000:3.0:1789776404.104940:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471468800 00000100:00100000:3.0:1789776404.104948:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471468800 00000100:00100000:3.0:1789776404.105070:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789776404.105081:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+14:7597:x1876716471468800:12345-0@lo:502: 00000100:00100000:3.0:1789776404.105333:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+14:7597:x1876716471468800:12345-0@lo:502: Request processed in 253us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776404.105340:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789776404.105550:0:7597:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:7597:1876716471468800:0@lo:502: 00000040:00080000:2.0:1789776404.105623:0:7597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1789776404.105633:0:7597:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1789776404.106619:0:7611:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789776404.106636:0:7611:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9c86bab64d28) 00000020:00000080:1.0:1789776404.106658:0:7611:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1789776404.106741:0:7611:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c86af31b000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789776404.106745:0:7611:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c86af31b000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789776404.106748:0:7611:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c86af31b000 3 00010000:00080000:1.0:1789776404.106776:0:7611:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c86af619000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.106@tcp at head 00010000:00010000:1.0:1789776404.110900:0:7611:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1789776404.111316:0:7611:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789776404.111354:0:7611:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789776404.111367:0:7611:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x26940258de8eefc4 00000100:00080000:1.0:1789776404.111377:0:7611:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789776404.111383:0:7611:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c86af619000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1789776404.111420:0:7611:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c86ba3be300 x1876716471468928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789776404.111465:0:7611:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789776404.111563:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3272:1876716471468928:0@lo:38: 00000100:00100000:2.0:1789776404.111636:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776404.111888:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471468928 00000100:00100000:1.0:1789776404.111896:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471468928 00000100:00100000:1.0:1789776404.111942:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789776404.111949:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3272:x1876716471468928:12345-0@lo:38: 00010000:00080000:1.0:1789776404.112189:0:5811:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 156 last 0 00000020:00000080:1.0:1789776404.112265:0:5811:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x26940258de8eefcb 00000004:00100000:1.0:1789776404.112293:0:5811:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789776404.112324:0:5811:0:(import.c:65:import_set_state_nolock()) ffff9c86af61f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789776404.112377:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3272:x1876716471468928:12345-0@lo:38: Request processed in 427us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776404.112385:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789776404.112482:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c86ba3be300 x1876716471468928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789776414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776404.112493:0:3272:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789776404.112500:0:3272:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1789776404.112508:0:3272:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789776404.112513:0:3272:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789776404.112516:0:3272:0:(import.c:65:import_set_state_nolock()) ffff9c86af619000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789776404.112522:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3272:1876716471468928:0@lo:38: 00000100:00100000:3.0:1789776404.112737:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789776404.112749:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb4f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3275:1876716471469056:0@lo:400: 00000100:00100000:3.0:1789776404.112796:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776404.112830:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb4f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3273:1876716471469184:0@lo:400: 00000100:00100000:3.0:1789776404.112855:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776404.112874:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789776404.112879:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb4f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471469312:0@lo:400: 00000100:00100000:3.0:1789776404.112905:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776404.112931:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471469056 00000100:00100000:3.0:1789776404.112935:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471469056 00000100:00100000:3.0:1789776404.113085:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471469184 00000100:00100000:3.0:1789776404.113090:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471469184 00000100:00100000:2.0:1789776404.114936:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789776404.114955:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1876716471469056:12345-0@lo:400: 00000100:00100000:2.0:1789776404.115631:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1876716471469056:12345-0@lo:400: Request processed in 683us (2835us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776404.115640:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789776404.115665:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789776404.115672:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1876716471469184:12345-0@lo:400: 00000100:00100000:2.0:1789776404.115706:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1876716471469184:12345-0@lo:400: Request processed in 36us (2851us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776404.115722:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1789776404.115768:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c86bb4f0700 x1876716471469184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776404.115783:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb4f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3273:1876716471469184:0@lo:400: 00010000:00080000:0.0:1789776404.116129:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c86bb4f1c00 x1876716471469056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776404.116141:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb4f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3275:1876716471469056:0@lo:400: 00000100:00100000:3.0:1789776404.116301:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471469312 00000100:00100000:3.0:1789776404.116308:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471469312 00000100:00100000:3.0:1789776404.116352:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789776404.116360:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471469312:12345-0@lo:400: 00000100:00100000:3.0:1789776404.116406:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471469312:12345-0@lo:400: Request processed in 48us (3500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776404.116412:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789776404.116428:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789776404.116432:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1789776404.116721:0:7611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:3.0:1789776404.116862:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb4f3b80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7613:1876716471469440:0@lo:901: 00000100:00100000:3.0:1789776404.116906:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776404.116947:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471469440 00000100:00100000:3.0:1789776404.116951:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471469440 00000100:00100000:3.0:1789776404.117166:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789776404.117173:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7613:x1876716471469440:12345-0@lo:901: 00000100:00100000:3.0:1789776404.118870:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7613:x1876716471469440:12345-0@lo:901: Request processed in 1691us (1958us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776404.118890:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789776404.119205:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c86bb4f3480 x1876716471469312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776404.119238:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb4f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471469312:0@lo:400: 00000020:01000000:2.0:1789776404.119282:0:7597:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1789776404.119314:0:7597:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789776404.119331:0:7597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c86829e1200/0x26940258de8eefaf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eefb6 expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776404.119342:0:7597:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c86829e1200/0x26940258de8eefaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eefb6 expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789776404.119406:0:7597:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789776404.119409:0:7597:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789776404.119410:0:7597:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789776404.119411:0:7597:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789776404.119412:0:7597:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789776404.119414:0:7597:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789776404.119416:0:7597:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789776404.119417:0:7597:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789776404.119418:0:7597:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789776404.119420:0:7597:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789776404.119421:0:7597:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789776404.119425:0:7597:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1789776404.119427:0:7597:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789776404.119429:0:7597:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789776404.119430:0:7597:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789776404.119435:0:7597:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789776404.119436:0:7597:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789776404.119437:0:7597:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789776404.119438:0:7597:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789776404.119439:0:7597:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789776404.119439:0:7597:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789776404.119440:0:7597:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789776404.119441:0:7597:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789776404.119508:0:7597:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789776404.119523:0:7597:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:7597:1876716471469568:0@lo:253: 00000100:00100000:2.0:1789776404.119565:0:7597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776404.119594:0:7597:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf22b480 going to sleep for 11 seconds 00000100:00100000:0.0:1789776404.120279:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8687ef76c0 going to sleep for 11 seconds 00010000:00080000:0.0:1789776404.120311:0:7613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c86bb4f3b80 x1876716471469440/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789776420 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776404.120324:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb4f3b80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7613:1876716471469440:0@lo:901: 00000100:00080000:3.0:1789776404.120535:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789776404.120558:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471469568 00000100:00100000:3.0:1789776404.120565:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471469568 00000100:00100000:3.0:1789776404.121041:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789776404.121052:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+14:7597:x1876716471469568:12345-0@lo:253: 20000000:01000000:3.0:1789776404.121080:0:5804:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789776404.121094:0:5804:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789776404.170390:0:5804:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789776404.170410:0:5804:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1789776404.170576:0:5827:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789776404.170581:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789776404.170604:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c868afc6200/0x26940258de8eefd2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776404.170622:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c868afc7800/0x26940258de8eef23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8eef1c expref: 14 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776404.170630:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c868afc6200/0x26940258de8eefd2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776404.170669:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c868afc7800/0x26940258de8eef23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26940258de8eef1c expref: 14 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776404.170684:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c868afc7800/0x26940258de8eef23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26940258de8eef1c expref: 14 pid: 5806 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776404.170697:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc2d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5827:1876716471469696:0@lo:104: 00000100:00100000:2.0:1789776404.170756:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776404.170800:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf22b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776404.171143:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471469696 00000100:00100000:3.0:1789776404.171151:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471469696 00000100:00100000:3.0:1789776404.171197:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789776404.171206:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9db43398-240e-4f78-8778-c11d527e09a1+3:5827:x1876716471469696:12345-0@lo:104: 00010000:00010000:3.0:1789776404.171235:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c86829e0000/0x26940258de8eef1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8eef23 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776404.171307:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789776404.171313:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9db43398-240e-4f78-8778-c11d527e09a1+3:5827:x1876716471469696:12345-0@lo:104: Request processed in 109us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776404.171320:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789776404.171392:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc2d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5827:1876716471469696:0@lo:104: 00010000:00010000:1.0:1789776404.171416:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c868afc6200/0x26940258de8eefd2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776404.171680:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776404.171687:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c86829e0000/0x26940258de8eef1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8eef23 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776404.171710:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86829e0000 already unused, calling callback (ffffffffc1da0c20) 10000000:00010000:2.0:1789776404.171714:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c86829e0000/0x26940258de8eef1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26940258de8eef23 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776404.171722:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c86829e0000/0x26940258de8eef1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26940258de8eef23 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776404.171730:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c86829e0000/0x26940258de8eef1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26940258de8eef23 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776404.171735:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789776404.171774:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c86829e0000/0x26940258de8eef1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eef23 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776404.171781:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789776404.171826:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471469824:0@lo:103: 00000100:00100000:1.0:1789776404.171861:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789776404.171910:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c86829e0000/0x26940258de8eef1c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eef23 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776404.171917:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c86829e0000/0x26940258de8eef1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eef23 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776404.171939:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776404.171941:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776404.171943:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776404.175388:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471469824 00000100:00100000:2.0:1789776404.175403:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471469824 00010000:00010000:2.0:1789776404.175598:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c868afc7800/0x26940258de8eef23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8eef1c expref: 15 pid: 5806 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776404.175641:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789776404.175665:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c869880c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9db43398-240e-4f78-8778-c11d527e09a1+15:3275:x1876716471469824:12345-0@lo:103: 00010000:00010000:2.0:1789776404.175680:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776404.175687:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c868afc7800/0x26940258de8eef23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8eef1c expref: 15 pid: 5806 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776404.175700:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c868afc7800/0x26940258de8eef23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26940258de8eef1c expref: 15 pid: 5806 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776404.175719:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c868afc7800/0x26940258de8eef23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26940258de8eef1c expref: 15 pid: 5806 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776404.175737:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c868afc6200/0x26940258de8eefd2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776404.175746:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c868afc6200/0x26940258de8eefd2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789776404.175762:0:5796:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005181345s 00010000:00010000:2.0:1789776404.175767:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c868afc6200/0x26940258de8eefd2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776404.175774:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c868afc6200/0x26940258de8eefd2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776404.175780:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c868afc6200/0x26940258de8eefd2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776404.175786:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c868afc6200/0x26940258de8eefd2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776404.175792:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc6200 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:2.0:1789776404.175804:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c868afc6200/0x26940258de8eefd2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776404.175812:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c868afc6200/0x26940258de8eefd2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776404.180033:0:5827:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c868afc6200/0x26940258de8eefd2 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776404.180053:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c868afc6200/0x26940258de8eefd2 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776404.181313:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+14:7597:x1876716471469568:12345-0@lo:253: Request processed in 60254us (61739us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776404.181328:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789776404.181435:0:7597:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9db43398-240e-4f78-8778-c11d527e09a1:7597:1876716471469568:0@lo:253: 10000000:01000000:0.0:1789776404.181514:0:7597:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789776404.181518:0:7597:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789776404.181520:0:7597:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789776404.181521:0:7597:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789776404.181523:0:7597:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789776404.181524:0:7597:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789776404.181525:0:7597:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789776404.181527:0:7597:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789776404.181528:0:7597:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789776404.181530:0:7597:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789776404.181531:0:7597:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789776404.181533:0:7597:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789776404.181549:0:7597:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1789776404.183155:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c868afc6200/0x26940258de8eefd2 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776404.183174:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c868afc6200/0x26940258de8eefd2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776404.183195:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776404.188592:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c869880c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9db43398-240e-4f78-8778-c11d527e09a1+13:3275:x1876716471469824:12345-0@lo:103: Request processed in 12921us (16720us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776404.188606:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00080000:10000000:3.0:1789776404.189643:0:7597:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1789776404.189848:0:7597:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789776404.190574:0:7597:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789776404.190743:0:7597:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789776404.191579:0:7597:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789776404.191874:0:7597:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000100:00100000:1.0:1789776404.195429:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471469824:0@lo:103: 00000001:00000004:3.0:1789776404.197160:0:7597:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:3.0:1789776404.375421:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1789776404.394758:0:7597:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789776404.394766:0:7597:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789776404.394799:0:7597:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789776404.394852:0:7597:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.106@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789776404.394865:0:7597:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789776404.394890:0:7597:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1789776405.397404:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776406.422190:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776406.934787:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789776406.934814:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86af8c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471469952:0@lo:13: 00000100:00100000:3.0:1789776406.934886:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776406.935037:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471469952 00000100:00100000:0.0:1789776406.935048:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471469952 00000100:00100000:0.0:1789776406.935123:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789776406.935133:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471469952:12345-0@lo:13: 00002000:00000024:0.0:1789776406.935173:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789776406.935259:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471469952:12345-0@lo:13: Request processed in 118us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776406.935282:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1789776406.935445:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789776406.936647:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86af8c8e00 x1876716471469952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776422 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776406.936672:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86af8c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471469952:0@lo:13: 00010000:00010000:2.0:1789776407.449273:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776408.472720:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776409.496210:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb4f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9db43398-240e-4f78-8778-c11d527e09a1:3273:1876716471470080:0@lo:400: 00000100:00100000:3.0:1789776409.496327:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776409.496375:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb4f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3273:1876716471470592:0@lo:400: 00000100:00100000:3.0:1789776409.496401:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776409.496428:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789776409.496433:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb4f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3273:1876716471470208:0@lo:400: 00000100:00100000:3.0:1789776409.496453:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776409.496481:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb4f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3275:1876716471470336:0@lo:400: 00000100:00100000:3.0:1789776409.496504:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776409.496521:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789776409.496526:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb4f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471470464:0@lo:400: 00000100:00100000:3.0:1789776409.496575:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776409.496617:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471470592 00000100:00100000:3.0:1789776409.496625:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471470592 00000100:00100000:3.0:1789776409.496669:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471470208 00000100:00100000:3.0:1789776409.496672:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471470208 00000100:00100000:3.0:1789776409.496684:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471470336 00000100:00100000:3.0:1789776409.496687:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471470336 00000100:00100000:3.0:1789776409.496702:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789776409.496710:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1876716471470592:12345-0@lo:400: 00000100:00100000:3.0:1789776409.496758:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1876716471470592:12345-0@lo:400: Request processed in 49us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776409.496765:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789776409.496781:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789776409.496787:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1876716471470208:12345-0@lo:400: 00000100:00100000:3.0:1789776409.496812:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1876716471470208:12345-0@lo:400: Request processed in 27us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776409.496818:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789776409.496827:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789776409.496833:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1876716471470336:12345-0@lo:400: 00000100:00100000:3.0:1789776409.496859:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1876716471470336:12345-0@lo:400: Request processed in 26us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776409.496864:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789776409.497117:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471470080 00000100:00100000:1.0:1789776409.497122:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471470080 00000100:00100000:1.0:1789776409.497153:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789776409.497161:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+13:3273:x1876716471470080:12345-0@lo:400: 00000100:00100000:1.0:1789776409.497194:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+13:3273:x1876716471470080:12345-0@lo:400: Request processed in 34us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776409.497210:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00010000:1.0:1789776409.502708:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776409.510656:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471470464 00000100:00100000:3.0:1789776409.510671:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471470464 00000100:00100000:3.0:1789776409.510767:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789776409.510780:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471470464:12345-0@lo:400: 00000100:00100000:3.0:1789776409.510868:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471470464:12345-0@lo:400: Request processed in 92us (14291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776409.510898:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1789776409.513621:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789776409.513631:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789776409.514076:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bb4f3480 x1876716471470464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776409.514092:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb4f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471470464:0@lo:400: 00010000:00080000:3.0:1789776409.514106:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bb4f3b80 x1876716471470336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776409.514114:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb4f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3275:1876716471470336:0@lo:400: 00010000:00080000:3.0:1789776409.514156:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bb4f3100 x1876716471470208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776409.514164:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb4f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3273:1876716471470208:0@lo:400: 00000100:00100000:3.0:1789776409.514175:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb4f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9db43398-240e-4f78-8778-c11d527e09a1:3273:1876716471470080:0@lo:400: 00010000:00080000:3.0:1789776409.514186:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bb4f1c00 x1876716471470592/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776409.514192:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb4f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3273:1876716471470592:0@lo:400: 00010000:00010000:0.0:1789776410.517241:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789776410.632649:0:7954:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789776411.543394:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776412.061189:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789776412.061238:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86af8caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471470720:0@lo:13: 00000100:00100000:0.0:1789776412.061316:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776412.061381:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471470720 00000100:00100000:0.0:1789776412.061388:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471470720 00000100:00100000:0.0:1789776412.061444:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789776412.061454:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af8c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471470720:12345-0@lo:13: 00002000:00000024:0.0:1789776412.061490:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789776412.061535:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af8c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471470720:12345-0@lo:13: Request processed in 82us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776412.061543:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1789776412.061566:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789776412.061594:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86af8caa00 x1876716471470720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776428 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776412.061613:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86af8caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471470720:0@lo:13: 00010000:00010000:0.0:1789776412.567094:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789776413.076364:0:5808:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789776413.076373:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c86903b8800 from 30 10000000:01000000:3.0:1789776413.076378:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789776413.076424:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8681678000/0x26940258de8eefd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776413.076436:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c8681678000/0x26940258de8eefd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776413.076464:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c8681678000/0x26940258de8eefd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776413.076488:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf767800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471470848:0@lo:101: 00000100:00100000:3.0:1789776413.076569:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776413.076625:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8687ee9240 going to sleep for 11 seconds 00000100:00100000:0.0:1789776413.076837:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471470848 00000100:00100000:0.0:1789776413.076845:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471470848 00000100:00100000:0.0:1789776413.076898:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789776413.076907:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+13:5808:x1876716471470848:12345-0@lo:101: 00010000:00010000:0.0:1789776413.076920:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776413.076932:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c8680030a00/0x26940258de8eefe0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8eefd9 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776413.076961:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c8680030a00/0x26940258de8eefe0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8eefd9 expref: 14 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776413.076979:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c8680030a00/0x26940258de8eefe0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8eefd9 expref: 14 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776413.076988:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8680030a00, rc 0) 00000100:00100000:0.0:1789776413.077034:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+14:5808:x1876716471470848:12345-0@lo:101: Request processed in 128us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776413.077041:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789776413.077367:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf767800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471470848:0@lo:101: 00010000:00010000:3.0:1789776413.077384:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c8681678000/0x26940258de8eefd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eefe0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776413.077394:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c8681678000/0x26940258de8eefd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8eefe0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776413.077448:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf767800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471470976:0@lo:501: 00000100:00100000:3.0:1789776413.077473:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776413.077508:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8687ee9240 going to sleep for 11 seconds 00000100:00100000:1.0:1789776413.077599:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471470976 00000100:00100000:1.0:1789776413.077603:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471470976 00000100:00100000:1.0:1789776413.077633:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789776413.077640:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+14:5808:x1876716471470976:12345-0@lo:501: 00000100:00100000:1.0:1789776413.079558:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+14:5808:x1876716471470976:12345-0@lo:501: Request processed in 1913us (2078us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776413.079569:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789776413.079673:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf767800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471470976:0@lo:501: 00000100:00100000:2.0:1789776413.079720:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471471104:0@lo:503: 00000100:00100000:2.0:1789776413.079767:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776413.079802:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86b9e510c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776413.080342:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471471104 00000100:00100000:0.0:1789776413.080349:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471471104 00000100:00100000:0.0:1789776413.080396:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789776413.080405:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+14:5808:x1876716471471104:12345-0@lo:503: 00000100:00100000:0.0:1789776413.080762:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+14:5808:x1876716471471104:12345-0@lo:503: Request processed in 357us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776413.080770:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789776413.081128:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471471104:0@lo:503: 00000100:00100000:3.0:1789776413.081409:0:8058:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf764000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8058:1876716471471232:0@lo:502: 00000100:00100000:3.0:1789776413.081454:0:8058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776413.081483:0:8058:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8687ee9600 going to sleep for 11 seconds 00000100:00100000:3.0:1789776413.081504:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471471232 00000100:00100000:3.0:1789776413.081508:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471471232 00000100:00100000:3.0:1789776413.081530:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789776413.081537:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+14:8058:x1876716471471232:12345-0@lo:502: 00000100:00100000:3.0:1789776413.081768:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+14:8058:x1876716471471232:12345-0@lo:502: Request processed in 231us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776413.081780:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789776413.081818:0:8058:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf764000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8058:1876716471471232:0@lo:502: 00000100:00100000:3.0:1789776413.081881:0:8058:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf764000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8058:1876716471471360:0@lo:502: 00000100:00100000:3.0:1789776413.081914:0:8058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776413.081933:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471471360 00000100:00100000:3.0:1789776413.081937:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471471360 00000100:00100000:3.0:1789776413.081965:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789776413.081971:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+14:8058:x1876716471471360:12345-0@lo:502: 00000100:00100000:3.0:1789776413.082088:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+14:8058:x1876716471471360:12345-0@lo:502: Request processed in 117us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776413.082095:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789776413.082121:0:8058:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8687ee9600 going to sleep for 11 seconds 00000100:00100000:3.0:1789776413.082132:0:8058:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf764000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8058:1876716471471360:0@lo:502: 00000040:00080000:3.0:1789776413.082151:0:8058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1789776413.082212:0:5808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1789776413.082259:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789776413.082270:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8681678000/0x26940258de8eefd9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eefe0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776413.082281:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c8681678000/0x26940258de8eefd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eefe0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776413.082290:0:5808:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789776413.082293:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1789776413.082296:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789776413.082318:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8681678c00/0x26940258de8eefe7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776413.082331:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c8681678c00/0x26940258de8eefe7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776413.082340:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c8681678c00/0x26940258de8eefe7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776413.082352:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf764000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471471488:0@lo:101: 00000100:00100000:3.0:1789776413.082378:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776413.082397:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8687ee9600 going to sleep for 11 seconds 00000100:00100000:3.0:1789776413.082408:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471471488 00000100:00100000:3.0:1789776413.082411:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471471488 00000100:00100000:3.0:1789776413.082426:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789776413.082432:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+14:5808:x1876716471471488:12345-0@lo:101: 00010000:00010000:3.0:1789776413.082439:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776413.082450:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c8681678800/0x26940258de8eefee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8eefe7 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776413.082471:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c8681678800/0x26940258de8eefee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8eefe7 expref: 15 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776413.082481:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c8681678800/0x26940258de8eefee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8eefe7 expref: 15 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776413.082488:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8681678800, rc 0) 00000100:00100000:3.0:1789776413.082516:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+15:5808:x1876716471471488:12345-0@lo:101: Request processed in 84us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776413.082522:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789776413.082547:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf764000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471471488:0@lo:101: 00010000:00010000:3.0:1789776413.082564:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c8681678c00/0x26940258de8eefe7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eefee expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776413.082573:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c8681678c00/0x26940258de8eefe7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8eefee expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776413.082609:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf764000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471471616:0@lo:501: 00000100:00100000:3.0:1789776413.082633:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776413.082645:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8687ee9600 going to sleep for 11 seconds 00000100:00100000:3.0:1789776413.082655:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471471616 00000100:00100000:3.0:1789776413.082658:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471471616 00000100:00100000:3.0:1789776413.082672:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789776413.082677:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa595450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+15:5808:x1876716471471616:12345-0@lo:501: 00000100:00100000:3.0:1789776413.082876:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa595450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+15:5808:x1876716471471616:12345-0@lo:501: Request processed in 198us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776413.082882:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789776413.082907:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf764000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471471616:0@lo:501: 00000100:00100000:3.0:1789776413.082927:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf764000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471471744:0@lo:503: 00000100:00100000:3.0:1789776413.082960:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776413.082974:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8687ee9600 going to sleep for 11 seconds 00000100:00100000:3.0:1789776413.082985:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471471744 00000100:00100000:3.0:1789776413.082988:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471471744 00000100:00100000:3.0:1789776413.083005:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789776413.083011:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa597050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+15:5808:x1876716471471744:12345-0@lo:503: 00000100:00100000:3.0:1789776413.083309:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa597050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+15:5808:x1876716471471744:12345-0@lo:503: Request processed in 297us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776413.083315:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789776413.083349:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf764000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471471744:0@lo:503: 00000100:00100000:3.0:1789776413.083579:0:8059:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf764000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8059:1876716471471872:0@lo:502: 00000100:00100000:3.0:1789776413.083614:0:8059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776413.083632:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471471872 00000100:00100000:3.0:1789776413.083636:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471471872 00000100:00100000:3.0:1789776413.083653:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789776413.083658:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa594450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+15:8059:x1876716471471872:12345-0@lo:502: 00000100:00100000:3.0:1789776413.083814:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa594450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+15:8059:x1876716471471872:12345-0@lo:502: Request processed in 155us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776413.083821:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789776413.083855:0:8059:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8687ee96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776413.083866:0:8059:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf764000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8059:1876716471471872:0@lo:502: 00000020:01000000:3.0:1789776413.083884:0:8059:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789776413.083892:0:8059:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776413.083894:0:8059:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789776413.083898:0:8059:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789776413.083900:0:8059:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789776413.083914:0:8059:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf764000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8059:1876716471472000:0@lo:502: 00000100:00100000:3.0:1789776413.083944:0:8059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776413.083963:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471472000 00000100:00100000:3.0:1789776413.083967:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471472000 00000100:00100000:3.0:1789776413.083983:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789776413.083988:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa596c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+15:8059:x1876716471472000:12345-0@lo:502: 00000100:00100000:3.0:1789776413.084087:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa596c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+15:8059:x1876716471472000:12345-0@lo:502: Request processed in 98us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776413.084094:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789776413.084118:0:8059:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8687ef7540 going to sleep for 11 seconds 00000100:00100000:3.0:1789776413.084135:0:8059:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf764000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8059:1876716471472000:0@lo:502: 00000020:01000000:3.0:1789776413.084151:0:8059:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789776413.084155:0:8059:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776413.084156:0:8059:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789776413.084159:0:8059:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1789776413.090288:0:5808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1789776413.090329:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789776413.090341:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8681678c00/0x26940258de8eefe7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eefee expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776413.090353:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c8681678c00/0x26940258de8eefe7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eefee expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776413.090365:0:5808:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789776413.090367:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c86c01a7000 from 30 10000000:01000000:3.0:1789776413.090371:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789776413.090411:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8681679200/0x26940258de8eeff5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776413.090419:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c8681679200/0x26940258de8eeff5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776413.090430:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c8681679200/0x26940258de8eeff5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776413.090454:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf764000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471472128:0@lo:101: 00000100:00100000:3.0:1789776413.090523:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776413.090622:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8687ef7540 going to sleep for 11 seconds 00000100:00100000:0.0:1789776413.094662:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471472128 00000100:00100000:0.0:1789776413.094679:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471472128 00000100:00100000:0.0:1789776413.094746:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789776413.094756:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa596450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+15:5808:x1876716471472128:12345-0@lo:101: 00010000:00010000:0.0:1789776413.094772:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776413.094789:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c8680030400/0x26940258de8eeffc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8eeff5 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776413.094820:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c8680030400/0x26940258de8eeffc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8eeff5 expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776413.094832:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c8680030400/0x26940258de8eeffc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8eeff5 expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776413.095166:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8680030400, rc 0) 00000100:00100000:0.0:1789776413.095407:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa596450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+16:5808:x1876716471472128:12345-0@lo:101: Request processed in 652us (4882us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776413.095414:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789776413.099914:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf764000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471472128:0@lo:101: 00010000:00010000:3.0:1789776413.099947:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c8681679200/0x26940258de8eeff5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eeffc expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776413.100243:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c8681679200/0x26940258de8eeff5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8eeffc expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776413.100328:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf764000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471472256:0@lo:501: 00000100:00100000:3.0:1789776413.100392:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776413.100430:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8687ef7540 going to sleep for 11 seconds 00000100:00100000:1.0:1789776413.100553:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471472256 00000100:00100000:1.0:1789776413.100561:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471472256 00000100:00100000:1.0:1789776413.100604:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789776413.100613:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa596050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+16:5808:x1876716471472256:12345-0@lo:501: 00000100:00100000:1.0:1789776413.100906:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa596050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+16:5808:x1876716471472256:12345-0@lo:501: Request processed in 292us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776413.100915:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789776413.100966:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf764000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471472256:0@lo:501: 00000100:00100000:1.0:1789776413.100997:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471472384:0@lo:503: 00000100:00100000:1.0:1789776413.101046:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776413.101062:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bc8f6000 going to sleep for 11 seconds 00000100:00100000:1.0:1789776413.101074:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471472384 00000100:00100000:1.0:1789776413.101077:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471472384 00000100:00100000:1.0:1789776413.101098:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789776413.101104:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa595c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+16:5808:x1876716471472384:12345-0@lo:503: 00000100:00100000:1.0:1789776413.101276:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa595c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+16:5808:x1876716471472384:12345-0@lo:503: Request processed in 170us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776413.101291:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789776413.101325:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471472384:0@lo:503: 00000100:00100000:1.0:1789776413.101496:0:8060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8060:1876716471472512:0@lo:502: 00000100:00100000:1.0:1789776413.101528:0:8060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776413.101546:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471472512 00000100:00100000:1.0:1789776413.101550:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471472512 00000100:00100000:1.0:1789776413.101569:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789776413.101575:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa595850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+16:8060:x1876716471472512:12345-0@lo:502: 00000100:00100000:1.0:1789776413.101716:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa595850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+16:8060:x1876716471472512:12345-0@lo:502: Request processed in 140us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776413.101723:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789776413.101751:0:8060:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bc8f6900 going to sleep for 11 seconds 00000100:00100000:1.0:1789776413.101763:0:8060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8060:1876716471472512:0@lo:502: 00000100:00100000:1.0:1789776413.101799:0:8060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8060:1876716471472640:0@lo:502: 00000100:00100000:1.0:1789776413.101829:0:8060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776413.101846:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471472640 00000100:00100000:1.0:1789776413.101849:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471472640 00000100:00100000:1.0:1789776413.101868:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789776413.101874:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa597850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+16:8060:x1876716471472640:12345-0@lo:502: 00000100:00100000:1.0:1789776413.101987:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa597850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+16:8060:x1876716471472640:12345-0@lo:502: Request processed in 112us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776413.101993:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789776413.102018:0:8060:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bc8f6900 going to sleep for 11 seconds 00000100:00100000:1.0:1789776413.102029:0:8060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8060:1876716471472640:0@lo:502: 00000040:00080000:1.0:1789776413.102054:0:8060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1789776413.102099:0:5808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1789776413.102114:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789776413.102122:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8681679200/0x26940258de8eeff5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eeffc expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776413.102132:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c8681679200/0x26940258de8eeff5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eeffc expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776413.102141:0:5808:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789776413.102144:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c86c01a7000 from 5 10000000:01000000:1.0:1789776413.102146:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789776413.102170:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c86829e1000/0x26940258de8ef003 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776413.102178:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c86829e1000/0x26940258de8ef003 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776413.102187:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c86829e1000/0x26940258de8ef003 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776413.102212:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471472768:0@lo:101: 00000100:00100000:1.0:1789776413.102258:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776413.102270:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bc8f6900 going to sleep for 11 seconds 00000100:00100000:1.0:1789776413.102280:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471472768 00000100:00100000:1.0:1789776413.102283:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471472768 00000100:00100000:1.0:1789776413.102301:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789776413.102307:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa596850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+16:5808:x1876716471472768:12345-0@lo:101: 00010000:00010000:1.0:1789776413.102314:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776413.102333:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c86829e0800/0x26940258de8ef00a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8ef003 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776413.102353:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c86829e0800/0x26940258de8ef00a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8ef003 expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776413.102362:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c86829e0800/0x26940258de8ef00a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8ef003 expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776413.102371:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86829e0800, rc 0) 00000100:00100000:1.0:1789776413.102399:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa596850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+17:5808:x1876716471472768:12345-0@lo:101: Request processed in 93us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776413.102406:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789776413.102433:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471472768:0@lo:101: 00010000:00010000:1.0:1789776413.102444:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c86829e1000/0x26940258de8ef003 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef00a expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776413.102452:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c86829e1000/0x26940258de8ef003 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8ef00a expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776413.102492:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471472896:0@lo:256: 00000100:00100000:1.0:1789776413.102520:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776413.102532:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bc8f6900 going to sleep for 11 seconds 00000100:00100000:1.0:1789776413.102543:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471472896 00000100:00100000:1.0:1789776413.102546:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471472896 00000100:00100000:1.0:1789776413.102564:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789776413.102570:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa597c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+17:5808:x1876716471472896:12345-0@lo:256: 20000000:01000000:1.0:1789776413.102581:0:5806:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789776413.102597:0:5806:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789776413.102603:0:5806:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1789776413.102672:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa597c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+17:5808:x1876716471472896:12345-0@lo:256: Request processed in 102us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776413.102679:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789776413.102708:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471472896:0@lo:256: 10000000:01000000:1.0:1789776413.102743:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789776413.102749:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c86829e1000/0x26940258de8ef003 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef00a expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776413.102756:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c86829e1000/0x26940258de8ef003 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef00a expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776413.102762:0:5808:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789776413.102764:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1789776413.102767:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789776413.102781:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c86829e0a00/0x26940258de8ef011 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776413.102787:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c86829e0a00/0x26940258de8ef011 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776413.102794:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c86829e0a00/0x26940258de8ef011 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776413.102804:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471473024:0@lo:101: 00000100:00100000:1.0:1789776413.102828:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776413.102840:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bc8f6900 going to sleep for 11 seconds 00000100:00100000:1.0:1789776413.102850:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471473024 00000100:00100000:1.0:1789776413.102854:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471473024 00000100:00100000:1.0:1789776413.102872:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789776413.102884:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa594850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+17:5808:x1876716471473024:12345-0@lo:101: 00010000:00010000:1.0:1789776413.102891:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776413.102899:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c86829e1a00/0x26940258de8ef018 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8ef011 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776413.102912:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c86829e1a00/0x26940258de8ef018 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8ef011 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776413.102920:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c86829e1a00/0x26940258de8ef018 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8ef011 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776413.102927:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86829e1a00, rc 0) 00000100:00100000:1.0:1789776413.102954:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa594850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+18:5808:x1876716471473024:12345-0@lo:101: Request processed in 70us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776413.102960:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789776413.102987:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471473024:0@lo:101: 00010000:00010000:1.0:1789776413.102996:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c86829e0a00/0x26940258de8ef011 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef018 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776413.103003:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c86829e0a00/0x26940258de8ef011 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8ef018 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776413.103038:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471473152:0@lo:501: 00000100:00100000:1.0:1789776413.103062:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776413.103074:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bc8f6900 going to sleep for 11 seconds 00000100:00100000:1.0:1789776413.103083:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471473152 00000100:00100000:1.0:1789776413.103086:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471473152 00000100:00100000:1.0:1789776413.103105:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789776413.103111:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa597450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+18:5808:x1876716471473152:12345-0@lo:501: 00000100:00100000:1.0:1789776413.103346:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa597450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+18:5808:x1876716471473152:12345-0@lo:501: Request processed in 233us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776413.103352:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789776413.103378:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471473152:0@lo:501: 00000100:00100000:1.0:1789776413.103402:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471473280:0@lo:503: 00000100:00100000:1.0:1789776413.103432:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776413.103446:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bc8f6900 going to sleep for 11 seconds 00000100:00100000:1.0:1789776413.103456:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471473280 00000100:00100000:1.0:1789776413.103459:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471473280 00000100:00100000:1.0:1789776413.103480:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789776413.103485:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa594050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+18:5808:x1876716471473280:12345-0@lo:503: 00000100:00100000:1.0:1789776413.103737:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa594050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+18:5808:x1876716471473280:12345-0@lo:503: Request processed in 250us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776413.103744:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789776413.103779:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471473280:0@lo:503: 00000100:00100000:1.0:1789776413.103984:0:8061:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8061:1876716471473408:0@lo:502: 00000100:00100000:1.0:1789776413.104016:0:8061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776413.104033:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471473408 00000100:00100000:1.0:1789776413.104037:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471473408 00000100:00100000:1.0:1789776413.104057:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789776413.104062:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa595050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+18:8061:x1876716471473408:12345-0@lo:502: 00000100:00100000:0.0:1789776413.105709:0:8061:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bc8f60c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776413.111884:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa595050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+18:8061:x1876716471473408:12345-0@lo:502: Request processed in 7810us (7857us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776413.111899:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789776413.115785:0:8061:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8061:1876716471473408:0@lo:502: 00000020:01000000:0.0:1789776413.115838:0:8061:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789776413.115848:0:8061:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789776413.115858:0:8061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776413.115914:0:8061:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789776413.115922:0:8061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789776413.115926:0:8061:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.106@tcp to nid 0x20000c0a8ca6a (192.168.202.106@tcp) 00000020:01000000:0.0:1789776413.116080:0:8061:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789776413.116085:0:8061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789776413.116101:0:8061:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9c8692060000) 00000020:00000080:0.0:1789776413.116123:0:8061:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1789776413.116131:0:8061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789776413.116462:0:8061:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1789776413.116470:0:8061:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:0.0:1789776413.116499:0:8061:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x26940258de8ef026 00010000:00080000:0.0:1789776413.116594:0:8061:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c86921e3800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.106@tcp at head 00010000:00010000:0.0:1789776413.116823:0:8061:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1789776413.118186:0:8061:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1789776413.118213:0:8061:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789776413.118858:0:8061:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789776413.120212:0:8061:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789776413.120435:0:8061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1789776413.120499:0:8061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1789776413.122187:0:8062:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789776413.122195:0:8062:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789776413.129268:0:8061:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789776413.129286:0:8061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789776413.129322:0:8061:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789776413.129344:0:8061:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x26940258de8ef02d 00000100:00080000:0.0:1789776413.129355:0:8061:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789776413.129361:0:8061:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c86921e3800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1789776413.129399:0:8061:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c86af8caa00 x1876716471473536/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789776413.129426:0:8061:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789776413.129488:0:8061:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789776413.129492:0:8061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776413.129493:0:8061:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789776413.129496:0:8061:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789776413.129499:0:8061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776413.129500:0:8061:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789776413.129503:0:8061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789776413.129505:0:8061:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789776413.129744:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3275:1876716471473792:0@lo:400: 00000100:00100000:3.0:1789776413.129813:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776413.129850:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789776413.129856:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3275:1876716471473920:0@lo:400: 00000100:00100000:3.0:1789776413.129888:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776413.129920:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3274:1876716471474176:0@lo:400: 00000100:00100000:3.0:1789776413.129941:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776413.129969:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789776413.129974:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471474048:0@lo:400: 00000100:00100000:3.0:1789776413.129996:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776413.130031:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471473792 00000100:00100000:3.0:1789776413.130037:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471473792 00000100:00100000:3.0:1789776413.130070:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471473920 00000100:00100000:3.0:1789776413.130073:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471473920 00000100:00100000:3.0:1789776413.130093:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471474176 00000100:00100000:3.0:1789776413.130097:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471474176 00000100:00100000:3.0:1789776413.130112:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789776413.130120:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1876716471473792:12345-0@lo:400: 00000100:00100000:3.0:1789776413.130179:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1876716471473792:12345-0@lo:400: Request processed in 59us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776413.130186:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789776413.130212:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789776413.130245:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1876716471473920:12345-0@lo:400: 00000100:00100000:3.0:1789776413.130271:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1876716471473920:12345-0@lo:400: Request processed in 53us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776413.130277:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789776413.130288:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789776413.130293:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1876716471474176:12345-0@lo:400: 00000100:00100000:3.0:1789776413.130322:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1876716471474176:12345-0@lo:400: Request processed in 28us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776413.130327:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1789776413.130364:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bf766680 x1876716471474176/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776413.130377:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3274:1876716471474176:0@lo:400: 00010000:00080000:3.0:1789776413.130401:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bf764380 x1876716471473920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776413.130409:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3275:1876716471473920:0@lo:400: 00010000:00080000:3.0:1789776413.130418:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bf766d80 x1876716471473792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776413.130426:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3275:1876716471473792:0@lo:400: 00000100:00100000:3.0:1789776413.130462:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471474048 00000100:00100000:3.0:1789776413.130465:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471474048 00000100:00100000:3.0:1789776413.130494:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789776413.130500:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf764e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471474048:12345-0@lo:400: 00000100:00100000:3.0:1789776413.130548:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf764e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471474048:12345-0@lo:400: Request processed in 48us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776413.130554:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789776413.130579:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bf765500 x1876716471474048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776413.130588:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471474048:0@lo:400: 00000100:00080000:3.0:1789776413.130609:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789776413.131012:0:8061:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86af8cb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8061:1876716471473664:0@lo:502: 00000100:00100000:0.0:1789776413.131124:0:8061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776413.131158:0:8061:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8682e956c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776413.131250:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471473664 00000100:00100000:3.0:1789776413.131255:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471473664 00000100:00100000:3.0:1789776413.131280:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789776413.131287:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa594c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+18:8061:x1876716471473664:12345-0@lo:502: 00000100:00100000:3.0:1789776413.131513:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa594c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+18:8061:x1876716471473664:12345-0@lo:502: Request processed in 226us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776413.131520:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789776413.131647:0:8061:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86af8cb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8061:1876716471473664:0@lo:502: 00000020:01000000:0.0:1789776413.131680:0:8061:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789776413.131686:0:8061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776413.131688:0:8061:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789776413.131692:0:8061:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1789776413.131879:0:5808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1789776413.131906:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789776413.131917:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c86829e0a00/0x26940258de8ef011 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef018 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776413.131928:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c86829e0a00/0x26940258de8ef011 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef018 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776413.131938:0:5808:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789776413.131941:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c86aa63b370 from 1 10000000:01000000:1.0:1789776413.131943:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789776413.131982:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c86829e1800/0x26940258de8ef034 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776413.131990:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c86829e1800/0x26940258de8ef034 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776413.132000:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c86829e1800/0x26940258de8ef034 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776413.132016:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471474304:0@lo:101: 00000100:00100000:1.0:1789776413.132058:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776413.132110:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86af8caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3272:1876716471473536:0@lo:8: 00000100:00100000:2.0:1789776413.132145:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776413.132188:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471473536 00000100:00100000:2.0:1789776413.132209:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471473536 00000100:00100000:2.0:1789776413.132262:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789776413.132268:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3272:x1876716471473536:12345-0@lo:8: 00010000:00080000:2.0:1789776413.132289:0:6662:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 165 last 0 00000020:00000080:2.0:1789776413.132317:0:6662:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x26940258de8ef03b 00002000:00100000:2.0:1789776413.132331:0:6662:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9c86c0244000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396f ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789776413.132336:0:6662:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1789776413.132339:0:6662:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1789776413.132458:0:6662:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789776413.132623:0:6662:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789776413.132649:0:6662:0:(import.c:65:import_set_state_nolock()) ffff9c86c0246800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789776413.132693:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3272:x1876716471473536:12345-0@lo:8: Request processed in 424us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776413.132700:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789776413.132738:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86af8caa00 x1876716471473536/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789776423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776413.132746:0:3272:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789776413.132753:0:3272:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789776413.132761:0:3272:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789776413.132767:0:3272:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789776413.132769:0:3272:0:(import.c:65:import_set_state_nolock()) ffff9c86921e3800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789776413.132780:0:3272:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789776413.132785:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86af8caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3272:1876716471473536:0@lo:8: 00000004:00080000:2.0:1789776413.132820:0:8062:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789776413.132920:0:8062:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 165912702919ns, next at 0ns, rc = 0 00000100:00100000:1.0:1789776413.144764:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86a03ae6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776413.144943:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471474304 00000100:00100000:0.0:1789776413.144954:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471474304 00000100:00100000:0.0:1789776413.145016:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789776413.145028:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+18:5808:x1876716471474304:12345-0@lo:101: 00010000:00010000:0.0:1789776413.145063:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776413.145084:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c8680031400/0x26940258de8ef042 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8ef034 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776413.145112:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c8680031400/0x26940258de8ef042 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8ef034 expref: 19 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776413.145120:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c8680031400/0x26940258de8ef042 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8ef034 expref: 19 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776413.145128:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8680031400, rc 0) 00000100:00100000:0.0:1789776413.145181:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+19:5808:x1876716471474304:12345-0@lo:101: Request processed in 156us (13123us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776413.145186:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789776413.145362:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471474304:0@lo:101: 00010000:00010000:1.0:1789776413.145379:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c86829e1800/0x26940258de8ef034 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef042 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776413.145389:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c86829e1800/0x26940258de8ef034 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8ef042 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776413.145454:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471474432:0@lo:501: 00000100:00100000:1.0:1789776413.145497:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776413.145525:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86a03ae6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776413.145569:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471474432 00000100:00100000:0.0:1789776413.145573:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471474432 00000100:00100000:0.0:1789776413.145601:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789776413.145608:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+19:5808:x1876716471474432:12345-0@lo:501: 00000100:00100000:0.0:1789776413.145842:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+19:5808:x1876716471474432:12345-0@lo:501: Request processed in 234us (344us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789776413.145954:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471474432:0@lo:501: 10000000:01000000:1.0:1789776413.145982:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789776413.145989:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c86829e1800/0x26940258de8ef034 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef042 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776413.145999:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c86829e1800/0x26940258de8ef034 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef042 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776413.146038:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000004:00080000:1.0:1789776413.193539:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1789776413.253864:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789776413.253890:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471474560:0@lo:13: 00000100:00100000:2.0:1789776413.253973:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1789776413.254212:0:8063:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1789776413.254267:0:8063:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8063:1876716471474688:0@lo:7: 00000100:00100000:2.0:1789776413.254296:0:8063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776413.254371:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471474560 00000100:00100000:1.0:1789776413.254379:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471474560 00000100:00100000:1.0:1789776413.254434:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789776413.254444:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3276:x1876716471474560:12345-0@lo:13: 00002000:00000024:1.0:1789776413.254477:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1789776413.254526:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3276:x1876716471474560:12345-0@lo:13: Request processed in 84us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776413.254533:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1789776413.254554:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789776413.254584:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86babc1880 x1876716471474560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776429 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776413.254613:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471474560:0@lo:13: 00000100:00100000:3.0:1789776413.254942:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471474688 00000100:00100000:3.0:1789776413.254948:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471474688 00000100:00100000:3.0:1789776413.254989:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789776413.254998:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8063:x1876716471474688:12345-0@lo:7: 00000100:00100000:2.0:1789776413.255928:0:8063:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86b9e51240 going to sleep for 11 seconds 00002000:00080000:3.0:1789776413.275339:0:6662:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1789776413.275349:0:6662:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1789776413.276261:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8063:x1876716471474688:12345-0@lo:7: Request processed in 21259us (21958us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776413.276274:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789776413.276428:0:8063:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86babc2680 x1876716471474688/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789776429 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776413.276455:0:8063:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8063:1876716471474688:0@lo:7: 00000004:00080000:2.0:1789776413.276471:0:8063:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1789776413.276515:0:8063:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8063:1876716471474816:0@lo:5: 00000100:00100000:2.0:1789776413.276559:0:8063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776413.276633:0:8063:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86b9e51240 going to sleep for 11 seconds 00000100:00100000:1.0:1789776413.277916:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471474816 00000100:00100000:1.0:1789776413.277928:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471474816 00000100:00100000:1.0:1789776413.277994:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789776413.278004:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8063:x1876716471474816:12345-0@lo:5: 00002000:00080000:1.0:1789776413.278075:0:6659:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1789776413.278078:0:6659:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1789776413.278454:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:8063:x1876716471474816:12345-0@lo:5: Request processed in 451us (1893us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789776413.278461:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789776413.278812:0:8063:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86babc2680 x1876716471474816/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789776429 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776413.278839:0:8063:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8063:1876716471474816:0@lo:5: 00000004:00080000:3.0:1789776413.278864:0:8063:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789776413.278899:0:8063:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf765500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8063:1876716471474944:0@lo:700: 00000100:00100000:3.0:1789776413.278933:0:8063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776413.278961:0:8063:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8698780d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789776413.279340:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471474944 00000100:00100000:1.0:1789776413.279347:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471474944 00000100:00100000:1.0:1789776413.279388:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789776413.279396:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8063:x1876716471474944:12345-0@lo:700: 00000100:00100000:1.0:1789776413.279427:0:6668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bf100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6668:1876716471475072:0@lo:700: 00000100:00100000:1.0:1789776413.279472:0:6668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776413.279495:0:6668:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86a03ae6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776413.279600:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471475072 00000100:00100000:3.0:1789776413.279604:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471475072 00000100:00100000:3.0:1789776413.279637:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789776413.279644:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba3bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6668:x1876716471475072:12345-0@lo:700: 40000000:02000000:1.0:1789776413.349497:0:5818:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1789776413.355669:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba3bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6668:x1876716471475072:12345-0@lo:700: Request processed in 76016us (76186us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776413.355694:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789776413.355777:0:6668:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86ba3bf100 x1876716471475072/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789776429 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776413.355794:0:6668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bf100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6668:1876716471475072:0@lo:700: 40000000:02000000:0.0:1789776413.355808:0:6668:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:3.0:1789776413.408090:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1789776413.408107:0:7615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789776413.408275:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8063:x1876716471474944:12345-0@lo:700: Request processed in 128876us (129337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776413.408287:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789776413.408420:0:8063:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bf765500 x1876716471474944/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789776429 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776413.408433:0:8063:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789776413.408450:0:8063:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf765500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8063:1876716471474944:0@lo:700: 00000004:02000040:2.0:1789776413.434871:0:8063:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1789776413.437212:0:8063:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf765500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8063:1876716471475200:0@lo:5: 00000100:00100000:3.0:1789776413.437294:0:8063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776413.437359:0:8063:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf22ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1789776413.437628:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471475200 00000100:00100000:1.0:1789776413.437634:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471475200 00000100:00100000:1.0:1789776413.437678:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789776413.437687:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8063:x1876716471475200:12345-0@lo:5: 00002000:00080000:1.0:1789776413.441258:0:6659:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1789776413.441280:0:6659:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1789776413.443775:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8063:x1876716471475200:12345-0@lo:5: Request processed in 6081us (6473us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789776413.443798:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789776413.443826:0:8063:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bf765500 x1876716471475200/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789776429 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776413.443842:0:8063:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf765500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8063:1876716471475200:0@lo:5: 00000004:00080000:2.0:1789776413.443867:0:8063:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1789776413.589121:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776414.617075:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776415.639442:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789776416.157369:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1789776416.660425:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776417.178561:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86af8cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471475328:0@lo:13: 00000100:00100000:1.0:1789776417.178633:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776417.178926:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471475328 00000100:00100000:0.0:1789776417.178946:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471475328 00000100:00100000:0.0:1789776417.179005:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789776417.179014:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba3bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471475328:12345-0@lo:13: 00002000:00000024:0.0:1789776417.179048:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789776417.179090:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba3bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471475328:12345-0@lo:13: Request processed in 78us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776417.179097:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1789776417.179242:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789776417.179269:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86af8cb800 x1876716471475328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776433 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776417.179290:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86af8cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471475328:0@lo:13: 00000100:00100000:3.0:1789776417.630927:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776417.631692:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462014848 00000100:00100000:1.0:1789776417.631704:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462014848 00000100:00100000:1.0:1789776417.631763:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 110 00000100:00100000:1.0:1789776417.631771:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa593c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2353:x1876716462014848:12345-192.168.202.6@tcp:250: 00010000:00080000:1.0:1789776417.631799:0:5804:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from f1af4197-a97c-41fa-81ad-cfe74d1f3bbe@192.168.202.6@tcp t0 exp 0000000000000000 cur 170 last 0 00000020:00000080:1.0:1789776417.631953:0:5804:0:(genops.c:1385:class_connect()) connect: client f1af4197-a97c-41fa-81ad-cfe74d1f3bbe, cookie 0x26940258de8ef049 00000100:00080000:1.0:1789776417.632101:0:5804:0:(import.c:65:import_set_state_nolock()) ffff9c86af61c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789776417.632296:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa593c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+5:2353:x1876716462014848:12345-192.168.202.6@tcp:250: Request processed in 524us (1377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776417.632305:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 110 00000100:00100000:1.0:1789776417.638978:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776417.639094:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462014720 00000100:00100000:3.0:1789776417.639105:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462014720 00000100:00100000:3.0:1789776417.639251:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 111 00000100:00100000:3.0:1789776417.639264:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa590850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+5:5584:x1876716462014720:12345-192.168.202.6@tcp:101: 00010000:00010000:3.0:1789776417.639299:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776417.639317:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c8681679800/0x26940258de8ef050 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c25b8 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776417.639360:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c8681679800/0x26940258de8ef050 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c25b8 expref: 6 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776417.639373:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c8681679800/0x26940258de8ef050 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c25b8 expref: 6 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776417.639382:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8681679800, rc 0) 00000100:00100000:3.0:1789776417.639458:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa590850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+6:5584:x1876716462014720:12345-192.168.202.6@tcp:101: Request processed in 197us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776417.639465:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 111 00000100:00100000:0.0:1789776417.648605:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776417.648724:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462014976 00000100:00100000:1.0:1789776417.648734:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462014976 00000100:00100000:1.0:1789776417.648819:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 112 00000100:00100000:1.0:1789776417.648830:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+6:5584:x1876716462014976:12345-192.168.202.6@tcp:501: 00000100:00100000:1.0:1789776417.649245:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+6:5584:x1876716462014976:12345-192.168.202.6@tcp:501: Request processed in 385us (619us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789776417.649265:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 112 00000100:00100000:2.0:1789776417.662595:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776417.662899:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462015104 00000100:00100000:3.0:1789776417.662912:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462015104 00000100:00100000:3.0:1789776417.663025:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 113 00000100:00100000:3.0:1789776417.663037:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa590050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+6:5584:x1876716462015104:12345-192.168.202.6@tcp:101: 00010000:00010000:3.0:1789776417.663055:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776417.663075:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c8681679a00/0x26940258de8ef057 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c25bf expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776417.663108:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c8681679a00/0x26940258de8ef057 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c25bf expref: 7 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776417.663119:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c8681679a00/0x26940258de8ef057 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c25bf expref: 7 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776417.663128:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8681679a00, rc 0) 00000100:00100000:3.0:1789776417.663260:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa590050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+7:5584:x1876716462015104:12345-192.168.202.6@tcp:101: Request processed in 225us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776417.663267:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 113 00000100:00100000:3.0:1789776417.673765:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776417.673913:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462015232 00000100:00100000:1.0:1789776417.673923:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462015232 00000100:00100000:1.0:1789776417.673974:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 114 00000100:00100000:1.0:1789776417.673982:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+7:5584:x1876716462015232:12345-192.168.202.6@tcp:501: 00000100:00100000:1.0:1789776417.674993:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+8:5584:x1876716462015232:12345-192.168.202.6@tcp:501: Request processed in 1007us (1234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776417.675004:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 114 00010000:00010000:2.0:1789776417.684485:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776417.688889:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776417.689050:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462015360 00000100:00100000:3.0:1789776417.689061:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462015360 00000100:00100000:3.0:1789776417.689126:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 115 00000100:00100000:3.0:1789776417.689137:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+8:5584:x1876716462015360:12345-192.168.202.6@tcp:503: 00000100:00100000:3.0:1789776417.689575:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+8:5584:x1876716462015360:12345-192.168.202.6@tcp:503: Request processed in 439us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776417.689583:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 115 00000100:00100000:2.0:1789776417.694031:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776417.694127:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462015488 00000100:00100000:1.0:1789776417.694139:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462015488 00000100:00100000:1.0:1789776417.694206:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 116 00000100:00100000:1.0:1789776417.694250:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa591450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+8:5602:x1876716462015488:12345-192.168.202.6@tcp:502: 00000100:00100000:1.0:1789776417.694738:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa591450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+8:5602:x1876716462015488:12345-192.168.202.6@tcp:502: Request processed in 522us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776417.694748:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 116 00000100:00100000:1.0:1789776417.738366:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776417.742044:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462015616 00000100:00100000:3.0:1789776417.742063:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462015616 00000100:00100000:3.0:1789776417.742152:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 117 00000100:00100000:3.0:1789776417.742175:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa593050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+8:5602:x1876716462015616:12345-192.168.202.6@tcp:502: 00000100:00100000:3.0:1789776417.742645:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa593050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+8:5602:x1876716462015616:12345-192.168.202.6@tcp:502: Request processed in 480us (4286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776417.742654:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 117 00000100:00100000:2.0:1789776417.754124:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776417.754265:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462015744 00000100:00100000:1.0:1789776417.754275:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462015744 00000100:00100000:1.0:1789776417.754331:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 118 00000100:00100000:1.0:1789776417.754341:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa590450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+8:5584:x1876716462015744:12345-192.168.202.6@tcp:101: 00010000:00010000:1.0:1789776417.754358:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776417.754376:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c86829e0000/0x26940258de8ef05e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c25e9 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776417.754404:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c86829e0000/0x26940258de8ef05e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c25e9 expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776417.754430:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c86829e0000/0x26940258de8ef05e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c25e9 expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776417.754440:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86829e0000, rc 0) 00000100:00100000:1.0:1789776417.754508:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa590450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+9:5584:x1876716462015744:12345-192.168.202.6@tcp:101: Request processed in 168us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776417.754515:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 118 00000100:00100000:0.0:1789776417.766027:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776417.766384:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462015872 00000100:00100000:1.0:1789776417.766395:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462015872 00000100:00100000:1.0:1789776417.766456:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 119 00000100:00100000:1.0:1789776417.766468:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa592c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+9:5584:x1876716462015872:12345-192.168.202.6@tcp:256: 20000000:01000000:1.0:1789776417.766500:0:5806:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789776417.766530:0:5806:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789776417.766536:0:5806:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789776417.766539:0:5806:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789776417.766541:0:5806:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1789776417.768922:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa592c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+9:5584:x1876716462015872:12345-192.168.202.6@tcp:256: Request processed in 2446us (2899us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776417.768937:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 119 00000100:00100000:0.0:1789776417.773524:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776417.773643:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462016000 00000100:00100000:3.0:1789776417.773653:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462016000 00000100:00100000:0.0:1789776417.773950:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 120 00000100:00100000:0.0:1789776417.773964:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+9:5584:x1876716462016000:12345-192.168.202.6@tcp:101: 00010000:00010000:0.0:1789776417.773981:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776417.774000:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c8680031600/0x26940258de8ef065 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c25f0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776417.774029:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c8680031600/0x26940258de8ef065 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c25f0 expref: 10 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776417.774041:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c8680031600/0x26940258de8ef065 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c25f0 expref: 10 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776417.774050:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8680031600, rc 0) 00000100:00100000:0.0:1789776417.774566:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:5584:x1876716462016000:12345-192.168.202.6@tcp:101: Request processed in 603us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776417.774574:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 120 00000100:00100000:0.0:1789776417.777735:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776417.777825:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462016128 00000100:00100000:1.0:1789776417.777841:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462016128 00000100:00100000:1.0:1789776417.777976:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 121 00000100:00100000:1.0:1789776417.777987:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa592050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:5584:x1876716462016128:12345-192.168.202.6@tcp:501: 00000100:00100000:1.0:1789776417.778675:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa592050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:5584:x1876716462016128:12345-192.168.202.6@tcp:501: Request processed in 688us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776417.778684:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 121 00000100:00100000:2.0:1789776417.781211:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776417.781758:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462016256 00000100:00100000:0.0:1789776417.781780:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462016256 00000100:00100000:0.0:1789776417.781827:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 122 00000100:00100000:0.0:1789776417.781836:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:5584:x1876716462016256:12345-192.168.202.6@tcp:503: 00000100:00100000:0.0:1789776417.782466:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:5584:x1876716462016256:12345-192.168.202.6@tcp:503: Request processed in 628us (1261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776417.782475:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 122 00000100:00100000:2.0:1789776417.787641:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776417.787754:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462016384 00000100:00100000:3.0:1789776417.787766:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462016384 00000100:00100000:0.0:1789776417.787838:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 123 00000100:00100000:0.0:1789776417.787947:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa591850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:5606:x1876716462016384:12345-192.168.202.6@tcp:502: 00000100:00100000:0.0:1789776417.788491:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa591850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:5606:x1876716462016384:12345-192.168.202.6@tcp:502: Request processed in 643us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776417.788499:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 123 00000100:00100000:2.0:1789776417.791617:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776417.791699:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462016512 00000100:00100000:0.0:1789776417.791710:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462016512 00000100:00100000:0.0:1789776417.791801:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 124 00000100:00100000:0.0:1789776417.791823:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8691427450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:5606:x1876716462016512:12345-192.168.202.6@tcp:502: 00000100:00100000:0.0:1789776417.792211:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8691427450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:5606:x1876716462016512:12345-192.168.202.6@tcp:502: Request processed in 399us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776417.792262:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 124 00000100:00100000:2.0:1789776417.797729:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776417.797895:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462016640 00000100:00100000:3.0:1789776417.797910:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462016640 00000100:00100000:3.0:1789776417.797972:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4 00000100:00100000:3.0:1789776417.797982:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2353:x1876716462016640:12345-192.168.202.6@tcp:38: 00010000:00080000:3.0:1789776417.798015:0:5812:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 0795fb8a-e14a-4768-806c-f332ad101de7@192.168.202.6@tcp t0 exp 0000000000000000 cur 170 last 0 00000020:00000080:3.0:1789776417.798076:0:5812:0:(genops.c:1385:class_connect()) connect: client 0795fb8a-e14a-4768-806c-f332ad101de7, cookie 0x26940258de8ef06c 00000004:00100000:3.0:1789776417.798116:0:5812:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1789776417.798123:0:5812:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1789776417.882010:0:5812:0:(import.c:65:import_set_state_nolock()) ffff9c8683e82800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789776417.882094:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+6:2353:x1876716462016640:12345-192.168.202.6@tcp:38: Request processed in 84112us (84376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776417.882104:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4 00000100:00100000:1.0:1789776418.200142:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471475840:0@lo:400: 00000100:00100000:0.0:1789776418.200247:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9db43398-240e-4f78-8778-c11d527e09a1:3273:1876716471475456:0@lo:400: 00000100:00100000:1.0:1789776418.200263:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776418.200291:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776418.200296:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471475840 00000100:00100000:3.0:1789776418.200305:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471475840 00000100:00100000:2.0:1789776418.200361:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3274:1876716471475584:0@lo:400: 00000100:00100000:3.0:1789776418.200380:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789776418.200389:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba3bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471475840:12345-0@lo:400: 00000100:00100000:2.0:1789776418.200394:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776418.200419:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3275:1876716471475712:0@lo:400: 00000100:00100000:2.0:1789776418.200442:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776418.200501:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471475584 00000100:00100000:2.0:1789776418.200505:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471475584 00000100:00100000:1.0:1789776418.200518:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471475712 00000100:00100000:1.0:1789776418.200524:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471475712 00000100:00100000:2.0:1789776418.200539:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789776418.200548:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1876716471475584:12345-0@lo:400: 00000100:00100000:3.0:1789776418.200560:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba3bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471475840:12345-0@lo:400: Request processed in 172us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776418.200562:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789776418.200571:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1789776418.200581:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1876716471475584:12345-0@lo:400: Request processed in 35us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776418.200589:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789776418.200598:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471475456 00000100:00100000:3.0:1789776418.200599:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789776418.200604:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471475456 00000100:00100000:2.0:1789776418.200610:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789776418.200619:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1876716471475712:12345-0@lo:400: 00000100:00100000:1.0:1789776418.200639:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789776418.200649:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8691424c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+19:3273:x1876716471475456:12345-0@lo:400: 00000100:00100000:2.0:1789776418.200654:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1876716471475712:12345-0@lo:400: Request processed in 35us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776418.200662:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789776418.200696:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8691424c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+19:3273:x1876716471475456:12345-0@lo:400: Request processed in 49us (404us total) trans 0 rc 0/0 00010000:00080000:2.0:1789776418.200700:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86ba3bed80 x1876716471475712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776418.200704:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789776418.200720:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3275:1876716471475712:0@lo:400: 00000100:00080000:1.0:1789776418.200731:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789776418.200751:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86ba3bc380 x1876716471475840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776418.200761:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471475840:0@lo:400: 00010000:00080000:3.0:1789776418.200768:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86ba3bc000 x1876716471475584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776418.200779:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3274:1876716471475584:0@lo:400: 00000100:00100000:3.0:1789776418.200786:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471476096:0@lo:400: 00000100:00100000:3.0:1789776418.200830:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776418.200854:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471476096 00000100:00100000:2.0:1789776418.200859:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471476096 00000100:00080000:3.0:1789776418.202513:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789776418.202719:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789776418.202735:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471476096:12345-0@lo:400: 00000100:00100000:2.0:1789776418.202811:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471476096:12345-0@lo:400: Request processed in 84us (1981us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776418.202818:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789776418.202860:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86ba3be680 x1876716471476096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776418.202871:0:3274:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789776418.202887:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471476096:0@lo:400: 00000100:00100000:0.0:1789776418.205700:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9db43398-240e-4f78-8778-c11d527e09a1:3273:1876716471475456:0@lo:400: 00000100:00100000:0.0:1789776418.205717:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3273:1876716471475968:0@lo:400: 00000100:00100000:0.0:1789776418.205784:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776418.206668:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471475968 00000100:00100000:2.0:1789776418.206679:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471475968 00000100:00100000:2.0:1789776418.206750:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789776418.206759:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af8cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1876716471475968:12345-0@lo:400: 00000100:00100000:2.0:1789776418.207134:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af8cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1876716471475968:12345-0@lo:400: Request processed in 374us (1349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776418.207143:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1789776418.208639:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789776418.212694:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86ba3bd500 x1876716471475968/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776418.212739:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3273:1876716471475968:0@lo:400: 00010000:00010000:0.0:1789776418.708464:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776418.709615:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a01df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471476224:0@lo:13: 00000100:00100000:0.0:1789776418.709690:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776418.709817:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471476224 00000100:00100000:1.0:1789776418.709825:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471476224 00000100:00100000:1.0:1789776418.709889:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789776418.709899:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af8caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471476224:12345-0@lo:13: 00002000:00000024:1.0:1789776418.709946:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789776418.718096:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af8caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471476224:12345-0@lo:13: Request processed in 8185us (8392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776418.718116:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1789776418.719095:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86a01df100 x1876716471476224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776434 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776418.719168:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a01df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471476224:0@lo:13: 00000100:00100000:2.0:1789776418.896823:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776418.897185:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776418.904573:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462016768 00000100:00100000:1.0:1789776418.904591:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462016768 00000100:00100000:1.0:1789776418.904775:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462016896 00000100:00100000:1.0:1789776418.904792:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462016896 00000100:00100000:1.0:1789776418.904824:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5 00000100:00100000:1.0:1789776418.904833:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+7:0:x1876716462016768:12345-192.168.202.6@tcp:41: 00000004:00000024:1.0:1789776418.904900:0:5813:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789776418.908571:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 6 00000100:00100000:0.0:1789776418.908599:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+7:5584:x1876716462016896:12345-192.168.202.6@tcp:41: 00000004:00000024:0.0:1789776418.908655:0:5811:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789776418.908808:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+7:5584:x1876716462016896:12345-192.168.202.6@tcp:41: Request processed in 222us (11622us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776418.908816:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 6 00000100:00100000:1.0:1789776418.909387:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+6:0:x1876716462016768:12345-192.168.202.6@tcp:41: Request processed in 4552us (12575us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776418.909394:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5 00000100:00100000:0.0:1789776418.914572:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776418.914831:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462017024 00000100:00100000:1.0:1789776418.914842:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462017024 00000100:00100000:1.0:1789776418.915144:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 7 00000100:00100000:1.0:1789776418.915166:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+6:5584:x1876716462017024:12345-192.168.202.6@tcp:40: 00000100:00100000:1.0:1789776418.915311:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+6:5584:x1876716462017024:12345-192.168.202.6@tcp:40: Request processed in 157us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776418.915318:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 7 00000100:00080000:2.0:1789776418.917792:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789776418.929119:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776418.929183:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776418.929260:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776418.929299:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776418.929599:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462017408 00000100:00100000:1.0:1789776418.929611:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462017408 00000100:00100000:1.0:1789776418.929665:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 0 00000100:00100000:1.0:1789776418.929676:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+6:5584:x1876716462017408:12345-192.168.202.6@tcp:33: 00000100:00100000:2.0:1789776418.929762:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462017152 00000100:00100000:2.0:1789776418.929767:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462017152 00000100:00100000:2.0:1789776418.929792:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462017280 00000100:00100000:2.0:1789776418.929795:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462017280 00000100:00100000:2.0:1789776418.929809:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 8 00000100:00100000:2.0:1789776418.929816:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1876716462017152:12345-192.168.202.6@tcp:8: 00010000:00080000:2.0:1789776418.929856:0:6661:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 0795fb8a-e14a-4768-806c-f332ad101de7@192.168.202.6@tcp t0 exp 0000000000000000 cur 171 last 0 00000020:00000080:2.0:1789776418.929889:0:6661:0:(genops.c:1385:class_connect()) connect: client 0795fb8a-e14a-4768-806c-f332ad101de7, cookie 0x26940258de8ef073 00002000:00100000:2.0:1789776418.929901:0:6661:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0795fb8a-e14a-4768-806c-f332ad101de7/ffff9c86c0244800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789776418.929924:0:6661:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789776418.930883:0:6661:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789776418.930920:0:6661:0:(import.c:65:import_set_state_nolock()) ffff9c86c0243000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789776418.930993:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+6:2353:x1876716462017152:12345-192.168.202.6@tcp:8: Request processed in 1176us (1885us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776418.931008:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 8 00000100:00100000:2.0:1789776418.931034:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 9 00000100:00100000:2.0:1789776418.931040:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1876716462017280:12345-192.168.202.6@tcp:8: 00010000:00080000:2.0:1789776418.931059:0:6661:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 0795fb8a-e14a-4768-806c-f332ad101de7@192.168.202.6@tcp t0 exp 0000000000000000 cur 171 last 0 00000020:00000080:2.0:1789776418.931081:0:6661:0:(genops.c:1385:class_connect()) connect: client 0795fb8a-e14a-4768-806c-f332ad101de7, cookie 0x26940258de8ef07a 00002000:00100000:2.0:1789776418.931088:0:6661:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0795fb8a-e14a-4768-806c-f332ad101de7/ffff9c86c0240800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789776418.931097:0:6661:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1789776418.931464:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462017536 00000100:00100000:0.0:1789776418.931471:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462017536 00000100:00100000:0.0:1789776418.931512:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 126 00000100:00100000:0.0:1789776418.931521:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8691424050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:2357:x1876716462017536:12345-192.168.202.6@tcp:400: 00000100:00100000:0.0:1789776418.931582:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8691424050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:2357:x1876716462017536:12345-192.168.202.6@tcp:400: Request processed in 62us (2321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776418.931590:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 126 00002000:00080000:2.0:1789776418.933193:0:6661:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789776418.933800:0:6661:0:(import.c:65:import_set_state_nolock()) ffff9c86c0245800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789776418.933944:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+6:2353:x1876716462017280:12345-192.168.202.6@tcp:8: Request processed in 2900us (4642us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776418.933955:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 9 00000004:00080000:2.0:1789776418.970863:0:5814:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 41106us 00000004:00200000:2.0:1789776419.007862:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789776419.007990:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+6:5584:x1876716462017408:12345-192.168.202.6@tcp:33: Request processed in 78311us (78800us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776419.008006:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 0 00000100:00100000:3.0:1789776419.261190:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776419.261379:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462017664 00000100:00100000:1.0:1789776419.261390:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462017664 00000100:00100000:1.0:1789776419.261454:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 8 00000100:00100000:1.0:1789776419.261465:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+6:5623:x1876716462017664:12345-192.168.202.6@tcp:101: 00010000:00010000:1.0:1789776419.261488:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776419.261538:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef081 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c261a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776419.261610:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef088 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776419.261638:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef088 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776419.261653:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef088 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776419.261694:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789776419.261698:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789776419.261714:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef088 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776419.261740:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef081 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c261a expref: 8 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776419.261761:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef088 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c261a expref: 7 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776419.261770:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c8683789b00) 00010000:00010000:1.0:1789776419.261773:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789776419.261776:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86829e0400, rc 0) 00000100:00100000:1.0:1789776419.261998:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+7:5623:x1876716462017664:12345-192.168.202.6@tcp:101: Request processed in 534us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776419.262006:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 8 00010000:00010000:0.0:1789776419.732653:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776420.759560:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776421.780445:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776421.922810:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776421.922888:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462017792 00000100:00100000:0.0:1789776421.922899:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462017792 00000100:00100000:0.0:1789776421.922990:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 9 00000100:00100000:0.0:1789776421.923004:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+7:5675:x1876716462017792:12345-192.168.202.6@tcp:41: 00000004:00000024:0.0:1789776421.923053:0:5812:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789776421.923138:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+7:5675:x1876716462017792:12345-192.168.202.6@tcp:41: Request processed in 129us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776421.923146:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 9 00000100:00080000:2.0:1789776421.923487:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789776421.926498:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776421.926951:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462017920 00000100:00100000:3.0:1789776421.926962:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462017920 00000100:00100000:3.0:1789776421.927046:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 9 00000100:00100000:3.0:1789776421.927059:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af8c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0795fb8a-e14a-4768-806c-f332ad101de7+6:5675:x1876716462017920:12345-192.168.202.6@tcp:13: 00002000:00000024:3.0:1789776421.927108:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789776421.927203:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af8c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0795fb8a-e14a-4768-806c-f332ad101de7+6:5675:x1876716462017920:12345-192.168.202.6@tcp:13: Request processed in 147us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776421.927211:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 9 00000100:00080000:2.0:1789776421.929287:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789776421.931991:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776421.932574:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462018048 00000100:00100000:0.0:1789776421.932586:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462018048 00000100:00100000:0.0:1789776421.932736:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00100000:0.0:1789776421.932749:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0795fb8a-e14a-4768-806c-f332ad101de7+6:5675:x1876716462018048:12345-192.168.202.6@tcp:13: 00002000:00000024:0.0:1789776421.932799:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789776421.932879:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0795fb8a-e14a-4768-806c-f332ad101de7+6:5675:x1876716462018048:12345-192.168.202.6@tcp:13: Request processed in 134us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776421.932887:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00080000:2.0:1789776421.932948:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789776422.294661:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789776422.294689:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86af8c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471476352:0@lo:13: 00000100:00100000:1.0:1789776422.294765:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776422.295001:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471476352 00000100:00100000:0.0:1789776422.295010:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471476352 00000100:00100000:0.0:1789776422.295088:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789776422.295097:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba3bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471476352:12345-0@lo:13: 00002000:00000024:0.0:1789776422.295119:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789776422.295134:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789776422.295198:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba3bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471476352:12345-0@lo:13: Request processed in 101us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776422.295206:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1789776422.295550:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86af8c8a80 x1876716471476352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776438 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776422.295579:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86af8c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471476352:0@lo:13: 00010000:00010000:0.0:1789776422.807190:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789776422.901010:0:5833:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0795fb8a-e14a-4768-806c-f332ad101de7 00000001:00100000:0.0:1789776422.903662:0:7615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0795fb8a-e14a-4768-806c-f332ad101de7 00000100:00100000:2.0:1789776423.316595:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9db43398-240e-4f78-8778-c11d527e09a1:3273:1876716471476480:0@lo:400: 00000100:00100000:2.0:1789776423.316671:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776423.316726:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3273:1876716471476992:0@lo:400: 00000100:00100000:2.0:1789776423.316768:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776423.316798:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789776423.316805:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3273:1876716471476608:0@lo:400: 00000100:00100000:2.0:1789776423.316827:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776423.316846:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471477120:0@lo:400: 00000100:00100000:2.0:1789776423.316872:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776423.316902:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471476864:0@lo:400: 00000100:00100000:2.0:1789776423.316946:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776423.316977:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789776423.316983:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3276:1876716471476736:0@lo:400: 00000100:00100000:2.0:1789776423.317004:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776423.317037:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471476480 00000100:00100000:2.0:1789776423.317045:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471476480 00000100:00100000:2.0:1789776423.317095:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789776423.317104:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86c2071450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+19:3273:x1876716471476480:12345-0@lo:400: 00000100:00100000:2.0:1789776423.317161:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86c2071450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+19:3273:x1876716471476480:12345-0@lo:400: Request processed in 57us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776423.317169:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789776423.317202:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471476992 00000100:00100000:2.0:1789776423.317207:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471476992 00000100:00100000:2.0:1789776423.317263:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471476608 00000100:00100000:2.0:1789776423.317266:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471476608 00000100:00100000:2.0:1789776423.317278:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471476736 00000100:00100000:2.0:1789776423.317280:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471476736 00000100:00100000:2.0:1789776423.317295:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789776423.317301:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1876716471476992:12345-0@lo:400: 00000100:00100000:2.0:1789776423.317700:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1876716471476992:12345-0@lo:400: Request processed in 398us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776423.317717:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789776423.317734:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789776423.317740:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1876716471476608:12345-0@lo:400: 00000100:00100000:2.0:1789776423.317768:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1876716471476608:12345-0@lo:400: Request processed in 29us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776423.317774:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789776423.317785:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789776423.317791:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876716471476736:12345-0@lo:400: 00000100:00100000:2.0:1789776423.317824:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876716471476736:12345-0@lo:400: Request processed in 33us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776423.317829:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789776423.317853:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471477120 00000100:00100000:2.0:1789776423.317857:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471477120 00000100:00100000:2.0:1789776423.317883:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471476864 00000100:00100000:2.0:1789776423.317885:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471476864 00000100:00100000:2.0:1789776423.317899:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789776423.317904:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471477120:12345-0@lo:400: 00000100:00100000:2.0:1789776423.318632:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471477120:12345-0@lo:400: Request processed in 723us (1755us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776423.318640:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789776423.318657:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789776423.318664:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471476864:12345-0@lo:400: 00000100:00100000:2.0:1789776423.318694:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471476864:12345-0@lo:400: Request processed in 31us (1748us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776423.318699:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1789776423.318727:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789776423.318738:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789776423.323050:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3276:1876716471476736:0@lo:400: 00010000:00080000:1.0:1789776423.323072:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86ba3be680 x1876716471476864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776423.323096:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471476864:0@lo:400: 00000100:00100000:1.0:1789776423.323159:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3273:1876716471476608:0@lo:400: 00010000:00080000:1.0:1789776423.323172:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86ba3bed80 x1876716471477120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776423.323181:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471477120:0@lo:400: 00000100:00100000:1.0:1789776423.323192:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9db43398-240e-4f78-8778-c11d527e09a1:3273:1876716471476480:0@lo:400: 00000100:00100000:1.0:1789776423.323203:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3273:1876716471476992:0@lo:400: 00000001:00100000:2.0:1789776423.431240:0:6684:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0795fb8a-e14a-4768-806c-f332ad101de7 00010000:00010000:0.0:1789776423.831336:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776423.831727:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a01dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471477248:0@lo:13: 00000100:00100000:0.0:1789776423.831820:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776423.832013:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471477248 00000100:00100000:2.0:1789776423.832021:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471477248 00000100:00100000:2.0:1789776423.832082:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789776423.832093:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af8cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471477248:12345-0@lo:13: 00002000:00000024:2.0:1789776423.832164:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789776423.832242:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af8cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471477248:12345-0@lo:13: Request processed in 152us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776423.832250:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1789776423.832290:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86a01dc700 x1876716471477248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776439 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776423.832312:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a01dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471477248:0@lo:13: 00000100:00100000:1.0:1789776424.221479:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776424.221526:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776424.221554:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776424.221583:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776424.221610:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462018304 00000100:00100000:1.0:1789776424.221620:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462018304 00000100:00100000:1.0:1789776424.221683:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 25 00000100:00100000:1.0:1789776424.221694:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba3bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+6:2354:x1876716462018304:12345-192.168.202.6@tcp:400: 00000100:00100000:1.0:1789776424.221773:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba3bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+6:2354:x1876716462018304:12345-192.168.202.6@tcp:400: Request processed in 81us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776424.221781:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 25 00000100:00100000:1.0:1789776424.221805:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462018432 00000100:00100000:1.0:1789776424.221809:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462018432 00000100:00100000:1.0:1789776424.221835:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462018560 00000100:00100000:1.0:1789776424.221838:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462018560 00000100:00100000:1.0:1789776424.221856:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 9 00000100:00100000:1.0:1789776424.221862:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba3bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0795fb8a-e14a-4768-806c-f332ad101de7+5:2354:x1876716462018432:12345-192.168.202.6@tcp:400: 00000100:00100000:1.0:1789776424.221911:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba3bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0795fb8a-e14a-4768-806c-f332ad101de7+5:2354:x1876716462018432:12345-192.168.202.6@tcp:400: Request processed in 48us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776424.221917:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 9 00000100:00100000:1.0:1789776424.221930:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00100000:1.0:1789776424.221935:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba3bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0795fb8a-e14a-4768-806c-f332ad101de7+5:2354:x1876716462018560:12345-192.168.202.6@tcp:400: 00000100:00100000:1.0:1789776424.221954:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba3bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0795fb8a-e14a-4768-806c-f332ad101de7+5:2354:x1876716462018560:12345-192.168.202.6@tcp:400: Request processed in 19us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776424.221959:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00080000:1.0:1789776424.221973:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789776424.221976:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789776424.221979:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789776424.222342:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462018176 00000100:00100000:3.0:1789776424.222349:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462018176 00000100:00100000:3.0:1789776424.222387:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 128 00000100:00100000:3.0:1789776424.222448:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:2354:x1876716462018176:12345-192.168.202.6@tcp:400: 00000100:00100000:3.0:1789776424.222488:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:2354:x1876716462018176:12345-192.168.202.6@tcp:400: Request processed in 95us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776424.222495:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 128 00000001:02000400:1.0:1789776424.707681:0:8266:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1789776424.860820:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776425.876681:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776426.903040:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776427.414441:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789776427.414469:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86af8cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471477376:0@lo:13: 00000100:00100000:0.0:1789776427.414545:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776427.414616:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471477376 00000100:00100000:0.0:1789776427.414622:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471477376 00000100:00100000:0.0:1789776427.414678:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789776427.414689:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af8ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471477376:12345-0@lo:13: 00000100:00080000:1.0:1789776427.414835:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1789776427.415005:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789776427.415835:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af8ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471477376:12345-0@lo:13: Request processed in 1144us (1286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776427.415845:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1789776427.421203:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86af8cbb80 x1876716471477376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776443 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776427.421249:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86af8cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471477376:0@lo:13: 00010000:00010000:0.0:1789776427.925340:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776428.436492:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a01dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9db43398-240e-4f78-8778-c11d527e09a1:3273:1876716471477504:0@lo:400: 00000100:00100000:2.0:1789776428.436571:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776428.436617:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a01dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3273:1876716471478016:0@lo:400: 00000100:00100000:2.0:1789776428.436645:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776428.436671:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789776428.436677:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a01dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3273:1876716471477632:0@lo:400: 00000100:00100000:2.0:1789776428.436697:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776428.436712:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a01de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471478144:0@lo:400: 00000100:00100000:2.0:1789776428.436773:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776428.436805:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a01dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3275:1876716471477760:0@lo:400: 00000100:00100000:3.0:1789776428.437399:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471478016 00000100:00100000:3.0:1789776428.437409:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471478016 00000100:00100000:3.0:1789776428.437460:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471477632 00000100:00100000:3.0:1789776428.437463:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471477632 00000100:00100000:3.0:1789776428.437485:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789776428.437503:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1876716471478016:12345-0@lo:400: 00000100:00100000:3.0:1789776428.437562:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1876716471478016:12345-0@lo:400: Request processed in 60us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776428.437569:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789776428.437586:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789776428.437593:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1876716471477632:12345-0@lo:400: 00000100:00100000:3.0:1789776428.437620:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1876716471477632:12345-0@lo:400: Request processed in 28us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776428.437626:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789776428.437646:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471477504 00000100:00100000:3.0:1789776428.437649:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471477504 00000100:00100000:3.0:1789776428.437670:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789776428.437677:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+19:3273:x1876716471477504:12345-0@lo:400: 00000100:00100000:3.0:1789776428.437705:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+19:3273:x1876716471477504:12345-0@lo:400: Request processed in 28us (1134us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776428.437711:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789776428.437742:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a01df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471477888:0@lo:400: 00000100:00100000:3.0:1789776428.437771:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789776428.437804:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789776428.437823:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471478144 00000100:00100000:3.0:1789776428.437826:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471478144 00000100:00100000:3.0:1789776428.437871:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471477888 00000100:00100000:3.0:1789776428.437875:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471477888 00000100:00100000:3.0:1789776428.437888:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789776428.438302:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776428.438347:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471477760 00000100:00100000:2.0:1789776428.438352:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471477760 00000100:00100000:2.0:1789776428.438393:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789776428.438399:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1876716471477760:12345-0@lo:400: 00000100:00100000:2.0:1789776428.438439:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1876716471477760:12345-0@lo:400: Request processed in 41us (1610us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776428.438446:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789776428.438465:0:6659:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789776428.438473:0:6659:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1789776428.438489:0:6662:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789776428.438504:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789776428.438511:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471477888:12345-0@lo:400: 00000100:00100000:2.0:1789776428.438548:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471477888:12345-0@lo:400: Request processed in 37us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776428.438553:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789776428.438714:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a01dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3275:1876716471477760:0@lo:400: 00000100:00080000:2.0:1789776428.438848:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789776428.438853:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789776428.438877:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a01dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3273:1876716471477632:0@lo:400: 00000100:00100000:2.0:1789776428.438887:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a01dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9db43398-240e-4f78-8778-c11d527e09a1:3273:1876716471477504:0@lo:400: 00000100:00100000:2.0:1789776428.439677:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a01dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3273:1876716471478016:0@lo:400: 00010000:00080000:2.0:1789776428.439740:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86a01df480 x1876716471477888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776428.439751:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a01df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471477888:0@lo:400: 00000100:00100000:3.0:1789776428.440966:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9def800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471478144:12345-0@lo:400: 00000100:00100000:2.0:1789776428.443638:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9def800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471478144:12345-0@lo:400: Request processed in 5734us (6854us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776428.443655:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1789776428.443766:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86a01de300 x1876716471478144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776428.443784:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a01de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471478144:0@lo:400: 00010000:00010000:1.0:1789776428.949506:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789776428.951209:0:8414:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffce0c35b0 00000100:00100000:2.0:1789776428.952173:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86af8c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471478272:0@lo:13: 00000100:00100000:2.0:1789776428.952295:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776428.952631:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471478272 00000100:00100000:1.0:1789776428.952641:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471478272 00000100:00100000:1.0:1789776428.952697:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789776428.952708:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9deed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471478272:12345-0@lo:13: 00002000:00000024:1.0:1789776428.952756:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 20000000:00000080:3.0:1789776428.952845:0:8414:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c86bf5f8c00 uarg=0000000000000000 20000000:01000000:3.0:1789776428.952884:0:8414:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1789776428.952901:0:8414:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1789776428.952904:0:8414:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789776428.952909:0:8414:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789776428.952914:0:8414:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1789776428.952929:0:8414:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789776428.952931:0:8414:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789776428.953144:0:8414:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789776428.953148:0:8414:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789776428.954130:0:8415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1789776428.954711:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1789776428.954856:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1789776428.954893:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:3.0:1789776428.954905:0:8414:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789776428.954907:0:8414:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000100:00100000:1.0:1789776428.955629:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9deed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471478272:12345-0@lo:13: Request processed in 2915us (3327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776428.955642:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000040:00080000:3.0:1789776428.956065:0:8416:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1789776428.958513:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1789776428.958573:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1789776428.958633:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1789776428.958651:0:8414:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789776428.958654:0:8414:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00010000:00080000:2.0:1789776428.960468:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86af8c8380 x1876716471478272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776444 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776428.960498:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86af8c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471478272:0@lo:13: 00000040:00080000:3.0:1789776428.960972:0:8417:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1789776428.962056:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1789776428.962119:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1789776428.962156:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1789776428.962175:0:8414:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1789776428.962178:0:8414:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789776428.964052:0:8418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1789776428.965055:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1789776428.965147:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1789776428.965179:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:0.0:1789776428.965198:0:8414:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789776428.965461:0:8414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c8680031c00/0x26940258de8ef08f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776428.965484:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c868afc7400/0x26940258de8eef8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8eef85 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776428.965493:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c8680030800/0x26940258de8eefb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8eefaf expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776428.965500:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c8680030a00/0x26940258de8eefe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8eefd9 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776428.965507:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c8681678800/0x26940258de8eefee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8eefe7 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776428.965514:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c8680030400/0x26940258de8eeffc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8eeff5 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776428.965520:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c86829e1a00/0x26940258de8ef018 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8ef011 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776428.965526:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c8680031400/0x26940258de8ef042 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8ef034 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776428.965537:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c8681679800/0x26940258de8ef050 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c25b8 expref: 9 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776428.965546:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c8681679a00/0x26940258de8ef057 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c25bf expref: 9 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776428.965566:0:8414:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c8680031c00/0x26940258de8ef08f lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776428.965615:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c8681679a00/0x26940258de8ef057 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c25bf expref: 9 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776428.965634:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c8681679a00/0x26940258de8ef057 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c25bf expref: 9 pid: 5805 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776428.965650:0:8414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86af8c8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1876716471478400:192.168.202.6@tcp:104: 00010000:00010000:0.0:1789776428.965994:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c8681679800/0x26940258de8ef050 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c25b8 expref: 9 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776428.966004:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c8681679800/0x26940258de8ef050 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c25b8 expref: 9 pid: 5805 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776428.966012:0:8414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86af8c8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1876716471478528:192.168.202.6@tcp:104: 00010000:00010000:0.0:1789776428.966046:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c8680031400/0x26940258de8ef042 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26940258de8ef034 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776428.966055:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c8680031400/0x26940258de8ef042 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26940258de8ef034 expref: 18 pid: 5806 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776428.966064:0:8414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86af8cbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1876716471478656:0@lo:104: 00000100:00100000:0.0:1789776428.966115:0:8414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789776428.966158:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c86829e1a00/0x26940258de8ef018 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26940258de8ef011 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776428.966178:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c86829e1a00/0x26940258de8ef018 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26940258de8ef011 expref: 18 pid: 5806 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776428.966187:0:8414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa655880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1876716471478784:0@lo:104: 00000100:00100000:0.0:1789776428.966212:0:8414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789776428.966278:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c8680030400/0x26940258de8eeffc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26940258de8eeff5 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776428.966285:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c8680030400/0x26940258de8eeffc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26940258de8eeff5 expref: 18 pid: 5806 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776428.966293:0:8414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa654a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1876716471478912:0@lo:104: 00010000:00010000:0.0:1789776428.966317:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c8681678800/0x26940258de8eefee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26940258de8eefe7 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776428.966325:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c8681678800/0x26940258de8eefee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26940258de8eefe7 expref: 18 pid: 5806 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776428.966333:0:8414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa657480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1876716471479040:0@lo:104: 00010000:00010000:0.0:1789776428.966359:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c8680030a00/0x26940258de8eefe0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26940258de8eefd9 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776428.966367:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c8680030a00/0x26940258de8eefe0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26940258de8eefd9 expref: 18 pid: 5804 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776428.966373:0:8414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa654380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1876716471479168:0@lo:104: 00010000:00010000:0.0:1789776428.966394:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c8680030800/0x26940258de8eefb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26940258de8eefaf expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776428.966411:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c8680030800/0x26940258de8eefb6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26940258de8eefaf expref: 18 pid: 5806 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776428.966419:0:8414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa654000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1876716471479296:0@lo:104: 00010000:00010000:0.0:1789776428.966444:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c868afc7400/0x26940258de8eef8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26940258de8eef85 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776428.966452:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c868afc7400/0x26940258de8eef8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26940258de8eef85 expref: 18 pid: 5806 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776428.966460:0:8414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa656680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1876716471479424:0@lo:104: 00000100:00100000:0.0:1789776428.966476:0:8414:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8698723180 going to sleep for 11 seconds 00000100:00100000:3.0:1789776428.966961:0:5794:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789776428.966985:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776428.966999:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776428.967007:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776428.967018:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776428.967027:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776428.967035:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471478656 00000100:00100000:3.0:1789776428.967043:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471478656 00000100:00100000:3.0:1789776428.967093:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471478784 00000100:00100000:3.0:1789776428.967096:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471478784 00000100:00100000:3.0:1789776428.967109:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471478912 00000100:00100000:3.0:1789776428.967111:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471478912 00000100:00100000:3.0:1789776428.967117:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471479040 00000100:00100000:3.0:1789776428.967119:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471479040 00000100:00100000:3.0:1789776428.967127:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471479168 00000100:00100000:3.0:1789776428.967128:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471479168 00000100:00100000:3.0:1789776428.967136:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471479296 00000100:00100000:3.0:1789776428.967138:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471479296 00000100:00100000:3.0:1789776428.967145:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471479424 00000100:00100000:3.0:1789776428.967157:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471479424 00000100:00100000:3.0:1789776428.967175:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789776428.967186:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af8c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9db43398-240e-4f78-8778-c11d527e09a1+9:8414:x1876716471478656:12345-0@lo:104: 00010000:00010000:3.0:1789776428.967198:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c86829e1800/0x26940258de8ef034 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8ef042 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776428.967356:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789776428.967362:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af8c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9db43398-240e-4f78-8778-c11d527e09a1+9:8414:x1876716471478656:12345-0@lo:104: Request processed in 179us (1247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776428.967371:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789776428.967391:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789776428.967399:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af7aec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9db43398-240e-4f78-8778-c11d527e09a1+8:8414:x1876716471478784:12345-0@lo:104: 00010000:00010000:3.0:1789776428.967407:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c86829e0a00/0x26940258de8ef011 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8ef018 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776428.967447:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789776428.967451:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af7aec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9db43398-240e-4f78-8778-c11d527e09a1+8:8414:x1876716471478784:12345-0@lo:104: Request processed in 55us (1240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776428.967456:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789776428.967487:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789776428.967492:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9db43398-240e-4f78-8778-c11d527e09a1+7:8414:x1876716471478912:12345-0@lo:104: 00010000:00010000:3.0:1789776428.967500:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c8681679200/0x26940258de8eeff5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8eeffc expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776428.967523:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789776428.967527:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9db43398-240e-4f78-8778-c11d527e09a1+7:8414:x1876716471478912:12345-0@lo:104: Request processed in 36us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776428.967533:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789776428.967550:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789776428.967556:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf765880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9db43398-240e-4f78-8778-c11d527e09a1+6:8414:x1876716471479040:12345-0@lo:104: 00010000:00010000:3.0:1789776428.967563:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c8681678c00/0x26940258de8eefe7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8eefee expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776428.967588:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789776428.967592:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf765880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9db43398-240e-4f78-8778-c11d527e09a1+6:8414:x1876716471479040:12345-0@lo:104: Request processed in 38us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776428.967597:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789776428.967607:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789776428.967614:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf767100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9db43398-240e-4f78-8778-c11d527e09a1+5:8414:x1876716471479168:12345-0@lo:104: 00010000:00010000:3.0:1789776428.967621:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c8681678000/0x26940258de8eefd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8eefe0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776428.967643:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1789776428.967647:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf767100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9db43398-240e-4f78-8778-c11d527e09a1+5:8414:x1876716471479168:12345-0@lo:104: Request processed in 35us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776428.967653:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789776428.967663:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789776428.967669:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf766a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9db43398-240e-4f78-8778-c11d527e09a1+4:8414:x1876716471479296:12345-0@lo:104: 00010000:00010000:3.0:1789776428.967675:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c86829e1200/0x26940258de8eefaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8eefb6 expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776428.967699:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1789776428.967703:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf766a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9db43398-240e-4f78-8778-c11d527e09a1+4:8414:x1876716471479296:12345-0@lo:104: Request processed in 35us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776428.967707:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789776428.967740:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789776428.968006:0:8414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86af8cbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1876716471478656:0@lo:104: 00000100:00100000:0.0:1789776428.968015:0:8414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa655880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1876716471478784:0@lo:104: 00000100:00100000:0.0:1789776428.968021:0:8414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa654a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1876716471478912:0@lo:104: 00000100:00100000:0.0:1789776428.968028:0:8414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa657480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1876716471479040:0@lo:104: 00000100:00100000:0.0:1789776428.968034:0:8414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa654380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1876716471479168:0@lo:104: 00000100:00100000:0.0:1789776428.968063:0:8414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa654000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1876716471479296:0@lo:104: 00000100:00100000:3.0:1789776428.968366:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf764000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9db43398-240e-4f78-8778-c11d527e09a1+3:8414:x1876716471479424:12345-0@lo:104: 00010000:00010000:3.0:1789776428.968377:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c8681679000/0x26940258de8eef85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8eef8c expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776428.968420:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1789776428.968425:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf764000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9db43398-240e-4f78-8778-c11d527e09a1+3:8414:x1876716471479424:12345-0@lo:104: Request processed in 679us (1397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776428.968431:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1789776428.968452:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1789776428.968458:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c86829e1800/0x26940258de8ef034 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8ef042 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776428.968465:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86829e1800 already unused, calling callback (ffffffffc1da0c20) 10000000:00010000:3.0:1789776428.968470:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c86829e1800/0x26940258de8ef034 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x26940258de8ef042 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776428.968480:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c86829e1800/0x26940258de8ef034 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x26940258de8ef042 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789776428.968487:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c86829e1800/0x26940258de8ef034 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x26940258de8ef042 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776428.968493:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789776428.968581:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c86829e1800/0x26940258de8ef034 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8ef042 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776428.968589:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789776428.968612:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c86829e1800/0x26940258de8ef034 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8ef042 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776428.968632:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c86829e1800/0x26940258de8ef034 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8ef042 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776428.968648:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1789776428.968651:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c86829e0a00/0x26940258de8ef011 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8ef018 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776428.968657:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86829e0a00 already unused, calling callback (ffffffffc1da0c20) 10000000:00010000:3.0:1789776428.968661:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c86829e0a00/0x26940258de8ef011 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x26940258de8ef018 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776428.968668:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c86829e0a00/0x26940258de8ef011 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x26940258de8ef018 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789776428.968675:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c86829e0a00/0x26940258de8ef011 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x26940258de8ef018 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776428.968681:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789776428.968764:0:8414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa656680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1876716471479424:0@lo:104: 00010000:00010000:1.0:1789776428.969020:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1789776428.969192:0:8419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789776428.969200:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c8681679200/0x26940258de8eeff5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8eeffc expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776428.969207:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681679200 already unused, calling callback (ffffffffc1da0c20) 10000000:00010000:1.0:1789776428.969210:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c8681679200/0x26940258de8eeff5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x26940258de8eeffc expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776428.969237:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c8681679200/0x26940258de8eeff5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x26940258de8eeffc expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789776428.969244:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c8681679200/0x26940258de8eeff5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x26940258de8eeffc expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776428.969249:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789776428.971328:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789776428.971357:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471479552:0@lo:103: 00000100:00100000:2.0:1789776428.971436:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776428.971613:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471479552 00000100:00100000:0.0:1789776428.971623:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471479552 00010000:00010000:0.0:1789776428.971665:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c8680031400/0x26940258de8ef042 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8ef034 expref: 19 pid: 5806 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776428.971706:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789776428.971716:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9dec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9db43398-240e-4f78-8778-c11d527e09a1+19:3275:x1876716471479552:12345-0@lo:103: 00010000:00010000:0.0:1789776428.971776:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776428.971782:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c8680031400/0x26940258de8ef042 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8ef034 expref: 19 pid: 5806 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776428.971794:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c8680031400/0x26940258de8ef042 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26940258de8ef034 expref: 19 pid: 5806 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776428.971815:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c8680031400/0x26940258de8ef042 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26940258de8ef034 expref: 19 pid: 5806 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776428.971835:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776428.971871:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9dec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9db43398-240e-4f78-8778-c11d527e09a1+18:3275:x1876716471479552:12345-0@lo:103: Request processed in 156us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776428.971877:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789776428.972690:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471479552:0@lo:103: 00010000:00010000:2.0:1789776428.972994:0:8420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789776428.973091:0:8419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c8681678c00/0x26940258de8eefe7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8eefee expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776428.973102:0:8419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681678c00 already unused, calling callback (ffffffffc1da0c20) 10000000:00010000:0.0:1789776428.973107:0:8419:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c8681678c00/0x26940258de8eefe7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x26940258de8eefee expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776428.973116:0:8419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c8681678c00/0x26940258de8eefe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x26940258de8eefee expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789776428.973123:0:8419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c8681678c00/0x26940258de8eefe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x26940258de8eefee expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789776428.973129:0:8419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789776428.973176:0:8419:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c8681678c00/0x26940258de8eefe7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eefee expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776428.973197:0:8419:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789776428.973241:0:8419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c8681678c00/0x26940258de8eefe7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eefee expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776428.973249:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c8681678c00/0x26940258de8eefe7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eefee expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776428.973285:0:8419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789776428.973289:0:8419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c86829e1200/0x26940258de8eefaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8eefb6 expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776428.973296:0:8419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86829e1200 already unused, calling callback (ffffffffc1da0c20) 10000000:00010000:0.0:1789776428.973299:0:8419:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c86829e1200/0x26940258de8eefaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x26940258de8eefb6 expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776428.973305:0:8419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c86829e1200/0x26940258de8eefaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x26940258de8eefb6 expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789776428.973312:0:8419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c86829e1200/0x26940258de8eefaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x26940258de8eefb6 expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789776428.973317:0:8419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789776428.973335:0:8419:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c86829e1200/0x26940258de8eefaf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eefb6 expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776428.973341:0:8419:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789776428.973346:0:8419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c86829e1200/0x26940258de8eefaf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eefb6 expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776428.973352:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c86829e1200/0x26940258de8eefaf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eefb6 expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776428.973369:0:8419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789776428.973372:0:8419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c8681679000/0x26940258de8eef85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8eef8c expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776428.973378:0:8419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681679000 already unused, calling callback (ffffffffc1da0c20) 10000000:00010000:0.0:1789776428.973380:0:8419:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c8681679000/0x26940258de8eef85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x26940258de8eef8c expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776428.973387:0:8419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c8681679000/0x26940258de8eef85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x26940258de8eef8c expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789776428.973394:0:8419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c8681679000/0x26940258de8eef85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x26940258de8eef8c expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789776428.973399:0:8419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789776428.973414:0:8419:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c8681679000/0x26940258de8eef85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eef8c expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776428.973419:0:8419:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789776428.973427:0:8419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c8681679000/0x26940258de8eef85 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eef8c expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776428.973434:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c8681679000/0x26940258de8eef85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eef8c expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776428.973444:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776428.973446:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776428.973448:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776428.973582:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa655c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9db43398-240e-4f78-8778-c11d527e09a1:3273:1876716471479680:0@lo:103: 00000100:00100000:2.0:1789776428.973639:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776428.973688:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789776428.973694:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9db43398-240e-4f78-8778-c11d527e09a1:3273:1876716471479808:0@lo:103: 00000100:00100000:2.0:1789776428.973713:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776428.973944:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa657800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471479936:0@lo:103: 00000100:00100000:2.0:1789776428.973970:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776428.974004:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471479680 00000100:00100000:2.0:1789776428.974010:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471479680 00010000:00010000:2.0:1789776428.974035:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c8681678800/0x26940258de8eefee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8eefe7 expref: 18 pid: 5806 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776428.974063:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471479808 00000100:00100000:2.0:1789776428.974066:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471479808 00010000:00010000:2.0:1789776428.974093:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c8680030800/0x26940258de8eefb6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8eefaf expref: 19 pid: 5806 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776428.974105:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471479936 00000100:00100000:2.0:1789776428.974107:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471479936 00010000:00010000:2.0:1789776428.974119:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c868afc7400/0x26940258de8eef8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8eef85 expref: 20 pid: 5806 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776428.974133:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789776428.974141:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9ded500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9db43398-240e-4f78-8778-c11d527e09a1+20:3273:x1876716471479680:12345-0@lo:103: 00010000:00010000:2.0:1789776428.974153:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776428.974158:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c8681678800/0x26940258de8eefee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8eefe7 expref: 20 pid: 5806 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776428.974168:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c8681678800/0x26940258de8eefee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26940258de8eefe7 expref: 20 pid: 5806 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776428.974185:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c8681678800/0x26940258de8eefee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26940258de8eefe7 expref: 20 pid: 5806 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776428.974199:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776428.974333:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9ded500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9db43398-240e-4f78-8778-c11d527e09a1+19:3273:x1876716471479680:12345-0@lo:103: Request processed in 192us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776428.974340:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789776428.974356:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789776428.974363:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9dee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9db43398-240e-4f78-8778-c11d527e09a1+18:3273:x1876716471479808:12345-0@lo:103: 00010000:00010000:2.0:1789776428.974380:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776428.974385:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c8680030800/0x26940258de8eefb6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8eefaf expref: 18 pid: 5806 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776428.974393:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c8680030800/0x26940258de8eefb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26940258de8eefaf expref: 18 pid: 5806 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776428.974404:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c8680030800/0x26940258de8eefb6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26940258de8eefaf expref: 18 pid: 5806 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776428.974414:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776428.974439:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9dee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9db43398-240e-4f78-8778-c11d527e09a1+17:3273:x1876716471479808:12345-0@lo:103: Request processed in 77us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776428.974445:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789776428.974459:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789776428.974465:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9dedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9db43398-240e-4f78-8778-c11d527e09a1+16:3275:x1876716471479936:12345-0@lo:103: 00010000:00010000:2.0:1789776428.974472:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776428.974477:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c868afc7400/0x26940258de8eef8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8eef85 expref: 16 pid: 5806 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776428.974485:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c868afc7400/0x26940258de8eef8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26940258de8eef85 expref: 16 pid: 5806 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776428.974496:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c868afc7400/0x26940258de8eef8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26940258de8eef85 expref: 16 pid: 5806 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776428.974505:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776428.974529:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9dedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9db43398-240e-4f78-8778-c11d527e09a1+15:3275:x1876716471479936:12345-0@lo:103: Request processed in 65us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776428.974544:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789776428.974580:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9db43398-240e-4f78-8778-c11d527e09a1:3273:1876716471479808:0@lo:103: 00000100:00100000:2.0:1789776428.974589:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa655c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9db43398-240e-4f78-8778-c11d527e09a1:3273:1876716471479680:0@lo:103: 00000100:00100000:2.0:1789776428.974616:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa657800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471479936:0@lo:103: 00010000:00010000:3.0:1789776428.975822:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c86829e0a00/0x26940258de8ef011 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8ef018 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776428.975834:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789776428.975857:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c86829e0a00/0x26940258de8ef011 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8ef018 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776428.975865:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c86829e0a00/0x26940258de8ef011 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8ef018 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776428.975879:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776428.975891:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776428.975893:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776428.975907:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9db43398-240e-4f78-8778-c11d527e09a1:3276:1876716471480064:0@lo:103: 00000100:00100000:3.0:1789776428.975958:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776428.976012:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471480064 00000100:00100000:3.0:1789776428.976017:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471480064 00010000:00010000:3.0:1789776428.976039:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c86829e1a00/0x26940258de8ef018 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8ef011 expref: 15 pid: 5806 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776428.976062:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789776428.976079:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9db43398-240e-4f78-8778-c11d527e09a1+15:3276:x1876716471480064:12345-0@lo:103: 00010000:00010000:3.0:1789776428.976089:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776428.976101:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c86829e1a00/0x26940258de8ef018 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8ef011 expref: 15 pid: 5806 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776428.976111:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c86829e1a00/0x26940258de8ef018 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26940258de8ef011 expref: 15 pid: 5806 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776428.976123:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c86829e1a00/0x26940258de8ef018 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26940258de8ef011 expref: 15 pid: 5806 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776428.976136:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776428.976164:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9db43398-240e-4f78-8778-c11d527e09a1+14:3276:x1876716471480064:12345-0@lo:103: Request processed in 96us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776428.976171:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789776428.976201:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9db43398-240e-4f78-8778-c11d527e09a1:3276:1876716471480064:0@lo:103: 00010000:00010000:1.0:1789776428.976610:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c8681679200/0x26940258de8eeff5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eeffc expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776428.976618:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789776428.976647:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c8681679200/0x26940258de8eeff5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eeffc expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776428.976654:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c8681679200/0x26940258de8eeff5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eeffc expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776428.976666:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776428.976668:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776428.976670:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776428.976677:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789776428.976687:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9db43398-240e-4f78-8778-c11d527e09a1:3274:1876716471480192:0@lo:103: 00000100:00100000:1.0:1789776428.976715:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776428.976776:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471480192 00000100:00100000:1.0:1789776428.976781:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471480192 00010000:00010000:1.0:1789776428.976800:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c8680030400/0x26940258de8eeffc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8eeff5 expref: 14 pid: 5806 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776428.976817:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789776428.976824:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba3be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9db43398-240e-4f78-8778-c11d527e09a1+14:3274:x1876716471480192:12345-0@lo:103: 00010000:00010000:1.0:1789776428.976832:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776428.976836:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c8680030400/0x26940258de8eeffc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8eeff5 expref: 14 pid: 5806 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776428.976845:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c8680030400/0x26940258de8eeffc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26940258de8eeff5 expref: 14 pid: 5806 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776428.976857:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c8680030400/0x26940258de8eeffc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26940258de8eeff5 expref: 14 pid: 5806 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776428.976867:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776428.976895:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba3be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9db43398-240e-4f78-8778-c11d527e09a1+13:3274:x1876716471480192:12345-0@lo:103: Request processed in 71us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776428.976901:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789776428.976927:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9db43398-240e-4f78-8778-c11d527e09a1:3274:1876716471480192:0@lo:103: 00010000:00010000:1.0:1789776428.977248:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776428.977278:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776428.977281:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776428.977693:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776428.977761:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776428.977947:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462018688 00000100:00100000:1.0:1789776428.977953:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462018688 00010000:00010000:1.0:1789776428.977974:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c8681679a00/0x26940258de8ef057 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c25bf expref: 10 pid: 5805 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776428.978003:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462018816 00000100:00100000:1.0:1789776428.978013:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462018816 00010000:00010000:1.0:1789776428.978029:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c8681679800/0x26940258de8ef050 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c25b8 expref: 11 pid: 5805 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776428.978043:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 18 00000100:00100000:1.0:1789776428.978050:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c869880ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+11:2356:x1876716462018688:12345-192.168.202.6@tcp:103: 00010000:00010000:1.0:1789776428.978060:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776428.978065:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c8681679a00/0x26940258de8ef057 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c25bf expref: 11 pid: 5805 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776428.978088:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c8681679a00/0x26940258de8ef057 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c25bf expref: 11 pid: 5805 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776428.978104:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776428.978145:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c869880ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+11:2356:x1876716462018688:12345-192.168.202.6@tcp:103: Request processed in 95us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776428.978152:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 18 00000100:00100000:1.0:1789776428.978189:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 19 00000100:00100000:1.0:1789776428.978196:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa657800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:2356:x1876716462018816:12345-192.168.202.6@tcp:103: 00010000:00010000:1.0:1789776428.978204:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776428.978209:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c8681679800/0x26940258de8ef050 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c25b8 expref: 10 pid: 5805 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776428.978245:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c8681679800/0x26940258de8ef050 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c25b8 expref: 10 pid: 5805 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776428.978321:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776428.978344:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa657800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:2356:x1876716462018816:12345-192.168.202.6@tcp:103: Request processed in 148us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776428.978359:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 19 00010000:00010000:2.0:1789776428.979615:0:8420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c8681678000/0x26940258de8eefd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8eefe0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776428.979632:0:8420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681678000 already unused, calling callback (ffffffffc1da0c20) 10000000:00010000:2.0:1789776428.979636:0:8420:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c8681678000/0x26940258de8eefd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26940258de8eefe0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776428.979647:0:8420:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c8681678000/0x26940258de8eefd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26940258de8eefe0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776428.979654:0:8420:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c8681678000/0x26940258de8eefd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26940258de8eefe0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776428.979661:0:8420:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789776428.979892:0:8420:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c8681678000/0x26940258de8eefd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eefe0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776428.979901:0:8420:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789776428.979926:0:8420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c8681678000/0x26940258de8eefd9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eefe0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776428.979934:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c8681678000/0x26940258de8eefd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eefe0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776428.979974:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789776428.979997:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9db43398-240e-4f78-8778-c11d527e09a1:3273:1876716471480320:0@lo:103: 00000100:00100000:2.0:1789776428.980057:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789776428.980117:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776428.980119:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776428.980122:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776428.980212:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471480320 00000100:00100000:1.0:1789776428.980242:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471480320 00010000:00010000:1.0:1789776428.980396:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c8680030a00/0x26940258de8eefe0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8eefd9 expref: 13 pid: 5804 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776428.980455:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789776428.980464:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9dec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9db43398-240e-4f78-8778-c11d527e09a1+13:3273:x1876716471480320:12345-0@lo:103: 00010000:00010000:1.0:1789776428.980476:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776428.980480:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c8680030a00/0x26940258de8eefe0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8eefd9 expref: 13 pid: 5804 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776428.980492:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c8680030a00/0x26940258de8eefe0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26940258de8eefd9 expref: 13 pid: 5804 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776428.980505:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c8680030a00/0x26940258de8eefe0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26940258de8eefd9 expref: 13 pid: 5804 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776428.980520:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c8680031c00/0x26940258de8ef08f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776428.980529:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c8680031c00/0x26940258de8ef08f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776428.980544:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c8680031c00/0x26940258de8ef08f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776428.980551:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c8680031c00/0x26940258de8ef08f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776428.980569:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c8680031c00/0x26940258de8ef08f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776428.980576:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c8680031c00/0x26940258de8ef08f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776428.980582:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8680031c00 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:1.0:1789776428.980586:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c8680031c00/0x26940258de8ef08f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776428.980594:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c8680031c00/0x26940258de8ef08f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776428.980603:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c8680031c00/0x26940258de8ef08f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776428.980612:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776428.980648:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9dec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9db43398-240e-4f78-8778-c11d527e09a1+12:3273:x1876716471480320:12345-0@lo:103: Request processed in 186us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776428.980656:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789776428.980741:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9db43398-240e-4f78-8778-c11d527e09a1:3273:1876716471480320:0@lo:103: 00010000:00010000:3.0:1789776428.981011:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c8681679a00/0x26940258de8ef057 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c25bf expref: 9 pid: 5805 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776428.981035:0:8414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86af8c8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1876716471478400:192.168.202.6@tcp:104: 00010000:00010000:3.0:1789776428.981049:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c8681679800/0x26940258de8ef050 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c25b8 expref: 8 pid: 5805 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776428.981057:0:8414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86af8c8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1876716471478528:192.168.202.6@tcp:104: 00010000:00010000:3.0:1789776428.981116:0:8414:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c8680031c00/0x26940258de8ef08f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776428.981126:0:8414:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c8680031c00/0x26940258de8ef08f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776428.981132:0:8414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c8680031c00/0x26940258de8ef08f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776428.981138:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c8680031c00/0x26940258de8ef08f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776429.345094:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776429.345137:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776429.345171:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776429.345377:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462018944 00000100:00100000:3.0:1789776429.345390:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462018944 00000100:00100000:3.0:1789776429.345467:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 29 00000100:00100000:3.0:1789776429.345479:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba3bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+6:2355:x1876716462018944:12345-192.168.202.6@tcp:400: 00000100:00100000:3.0:1789776429.345565:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba3bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+6:2355:x1876716462018944:12345-192.168.202.6@tcp:400: Request processed in 87us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776429.345573:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 29 00000100:00080000:1.0:1789776429.345974:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789776429.346100:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462019072 00000100:00100000:2.0:1789776429.346105:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462019072 00000100:00100000:2.0:1789776429.346151:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462019200 00000100:00100000:2.0:1789776429.346154:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462019200 00000100:00100000:2.0:1789776429.346174:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 13 00000100:00100000:2.0:1789776429.346181:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba3be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0795fb8a-e14a-4768-806c-f332ad101de7+5:2355:x1876716462019072:12345-192.168.202.6@tcp:400: 00000100:00100000:2.0:1789776429.346246:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba3be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0795fb8a-e14a-4768-806c-f332ad101de7+5:2355:x1876716462019072:12345-192.168.202.6@tcp:400: Request processed in 36us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776429.346263:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 13 00000100:00100000:2.0:1789776429.346276:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 14 00000100:00100000:2.0:1789776429.346283:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba3bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0795fb8a-e14a-4768-806c-f332ad101de7+5:2355:x1876716462019200:12345-192.168.202.6@tcp:400: 00000100:00100000:2.0:1789776429.346306:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba3bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0795fb8a-e14a-4768-806c-f332ad101de7+5:2355:x1876716462019200:12345-192.168.202.6@tcp:400: Request processed in 24us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776429.346312:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 14 00000100:00080000:1.0:1789776429.346537:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789776429.346541:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789776429.972721:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776430.113996:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776430.115623:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462019328 00000100:00100000:2.0:1789776430.115638:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462019328 00000100:00100000:2.0:1789776430.115721:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 130 00000100:00100000:2.0:1789776430.115750:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+8:5598:x1876716462019328:12345-192.168.202.6@tcp:101: 00010000:00010000:2.0:1789776430.115769:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776430.115793:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c868afc7400/0x26940258de8ef096 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2621 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776430.115828:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c868afc7400/0x26940258de8ef096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2621 expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776430.115839:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c868afc7400/0x26940258de8ef096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2621 expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776430.115849:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c868afc7400, rc 0) 00000100:00100000:2.0:1789776430.115932:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+9:5598:x1876716462019328:12345-192.168.202.6@tcp:101: Request processed in 185us (1950us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776430.115939:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 130 00000100:00100000:1.0:1789776430.121016:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776430.121177:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462019456 00000100:00100000:3.0:1789776430.121192:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462019456 00000100:00100000:3.0:1789776430.121297:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 131 00000100:00100000:3.0:1789776430.121323:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+9:5598:x1876716462019456:12345-192.168.202.6@tcp:501: 00000100:00100000:3.0:1789776430.121647:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+9:5598:x1876716462019456:12345-192.168.202.6@tcp:501: Request processed in 324us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776430.121656:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 131 00000100:00100000:0.0:1789776430.141280:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776430.141847:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462019584 00000100:00100000:3.0:1789776430.141861:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462019584 00000100:00100000:3.0:1789776430.141933:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 132 00000100:00100000:3.0:1789776430.141945:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+9:5598:x1876716462019584:12345-192.168.202.6@tcp:503: 00000100:00100000:3.0:1789776430.142541:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+9:5598:x1876716462019584:12345-192.168.202.6@tcp:503: Request processed in 597us (1274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776430.142550:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 132 00000100:00100000:1.0:1789776430.152343:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776430.152525:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462019712 00000100:00100000:2.0:1789776430.152537:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462019712 00000100:00100000:2.0:1789776430.152614:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 133 00000100:00100000:2.0:1789776430.152626:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+9:6064:x1876716462019712:12345-192.168.202.6@tcp:502: 00000100:00100000:2.0:1789776430.152960:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+9:6064:x1876716462019712:12345-192.168.202.6@tcp:502: Request processed in 336us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776430.152969:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 133 00000100:00100000:1.0:1789776430.156498:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776430.175371:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462019840 00000100:00100000:0.0:1789776430.175391:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462019840 00000100:00100000:2.0:1789776430.176745:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 134 00000100:00100000:2.0:1789776430.176758:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+9:6064:x1876716462019840:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789776430.177082:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+9:6064:x1876716462019840:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 324us (20595us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776430.177101:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 134 00000100:00100000:0.0:1789776430.185397:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776430.185540:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462019968 00000100:00100000:3.0:1789776430.185564:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462019968 00000100:00100000:3.0:1789776430.185628:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 135 00000100:00100000:3.0:1789776430.185640:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+9:5598:x1876716462019968:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789776430.185656:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776430.185676:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c8681679800/0x26940258de8ef09d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2628 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776430.185717:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c8681679800/0x26940258de8ef09d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2628 expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776430.185730:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c8681679800/0x26940258de8ef09d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2628 expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776430.185741:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8681679800, rc 0) 00000100:00100000:3.0:1789776430.185812:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:5598:x1876716462019968:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 174us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776430.185834:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 135 00000100:00100000:0.0:1789776430.195110:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776430.195459:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462020096 00000100:00100000:1.0:1789776430.195469:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462020096 00000100:00100000:1.0:1789776430.195561:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 136 00000100:00100000:1.0:1789776430.195572:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:5598:x1876716462020096:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789776430.195868:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:5598:x1876716462020096:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 297us (767us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789776430.195876:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 136 10000000:01000000:0.0:1789776430.612734:0:5808:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789776430.612750:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c86af31b000 from 39 10000000:01000000:0.0:1789776430.612756:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789776430.612805:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8680030400/0x26940258de8ef0a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776430.612817:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c8680030400/0x26940258de8ef0a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776430.612829:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c8680030400/0x26940258de8ef0a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776430.612853:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa655c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471480448:0@lo:101: 00000100:00100000:0.0:1789776430.612923:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776430.612981:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86987230c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776430.613043:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471480448 00000100:00100000:1.0:1789776430.613052:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471480448 00000100:00100000:1.0:1789776430.613120:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789776430.613130:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+12:5808:x1876716471480448:12345-0@lo:101: 00010000:00010000:1.0:1789776430.613143:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776430.613157:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c86bf5ca000/0x26940258de8ef0ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8ef0a4 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776430.613183:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c86bf5ca000/0x26940258de8ef0ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8ef0a4 expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776430.613194:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c86bf5ca000/0x26940258de8ef0ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8ef0a4 expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776430.613203:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86bf5ca000, rc 0) 00000100:00100000:1.0:1789776430.613267:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+13:5808:x1876716471480448:12345-0@lo:101: Request processed in 138us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776430.613274:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789776430.614246:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa655c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471480448:0@lo:101: 00010000:00010000:0.0:1789776430.614268:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c8680030400/0x26940258de8ef0a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef0ab expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776430.614279:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c8680030400/0x26940258de8ef0a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8ef0ab expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776430.614350:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa655c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471480576:0@lo:501: 00000100:00100000:0.0:1789776430.614388:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776430.614427:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86987230c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776430.614850:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471480576 00000100:00100000:1.0:1789776430.614856:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471480576 00000100:00100000:1.0:1789776430.614901:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789776430.614910:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+13:5808:x1876716471480576:12345-0@lo:501: 00000100:00100000:1.0:1789776430.615209:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+13:5808:x1876716471480576:12345-0@lo:501: Request processed in 299us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776430.615234:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789776430.615274:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa655c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471480576:0@lo:501: 00000100:00100000:1.0:1789776430.615305:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471480704:0@lo:503: 00000100:00100000:1.0:1789776430.615343:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776430.615365:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf30e480 going to sleep for 11 seconds 00000100:00100000:1.0:1789776430.615377:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471480704 00000100:00100000:1.0:1789776430.615381:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471480704 00000100:00100000:1.0:1789776430.615404:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789776430.615410:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+13:5808:x1876716471480704:12345-0@lo:503: 00000100:00100000:1.0:1789776430.615561:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+13:5808:x1876716471480704:12345-0@lo:503: Request processed in 150us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776430.615568:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789776430.615604:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471480704:0@lo:503: 00000100:00100000:3.0:1789776430.619855:0:8440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8440:1876716471480832:0@lo:502: 00000100:00100000:3.0:1789776430.619958:0:8440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776430.620015:0:8440:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86a006b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776430.624364:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471480832 00000100:00100000:0.0:1789776430.624385:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471480832 00000100:00100000:0.0:1789776430.624465:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789776430.624476:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+13:8440:x1876716471480832:12345-0@lo:502: 00000100:00100000:0.0:1789776430.625292:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+13:8440:x1876716471480832:12345-0@lo:502: Request processed in 813us (5330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776430.625304:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789776430.626450:0:8440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8440:1876716471480832:0@lo:502: 00000100:00100000:3.0:1789776430.626527:0:8440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8440:1876716471480960:0@lo:502: 00000100:00100000:3.0:1789776430.626601:0:8440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776430.626643:0:8440:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86a03ae6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776430.628365:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471480960 00000100:00100000:0.0:1789776430.628380:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471480960 00000100:00100000:0.0:1789776430.628445:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789776430.628456:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+13:8440:x1876716471480960:12345-0@lo:502: 00000100:00100000:0.0:1789776430.629196:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+13:8440:x1876716471480960:12345-0@lo:502: Request processed in 741us (2593us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776430.629205:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789776430.631837:0:8440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8440:1876716471480960:0@lo:502: 00000040:00080000:3.0:1789776430.631895:0:8440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789776430.632698:0:5808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1789776430.632759:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789776430.632770:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8680030400/0x26940258de8ef0a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef0ab expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776430.632782:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c8680030400/0x26940258de8ef0a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef0ab expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776430.632792:0:5808:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1789776430.632795:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1789776430.632798:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789776430.632842:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c868afc7800/0x26940258de8ef0b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776430.632851:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c868afc7800/0x26940258de8ef0b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776430.632861:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c868afc7800/0x26940258de8ef0b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776430.632883:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9defb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471481088:0@lo:101: 00000100:00100000:2.0:1789776430.632955:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776430.632994:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86aa6e5900 going to sleep for 11 seconds 00000100:00100000:3.0:1789776430.633695:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471481088 00000100:00100000:3.0:1789776430.633715:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471481088 00000100:00100000:3.0:1789776430.633787:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789776430.633797:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+13:5808:x1876716471481088:12345-0@lo:101: 00010000:00010000:3.0:1789776430.633812:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776430.633829:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c8681679a00/0x26940258de8ef0b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8ef0b2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776430.633861:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c8681679a00/0x26940258de8ef0b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8ef0b2 expref: 14 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776430.633873:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c8681679a00/0x26940258de8ef0b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8ef0b2 expref: 14 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776430.633884:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8681679a00, rc 0) 00000100:00100000:3.0:1789776430.633946:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+14:5808:x1876716471481088:12345-0@lo:101: Request processed in 151us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776430.633970:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789776430.636200:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9defb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471481088:0@lo:101: 00010000:00010000:2.0:1789776430.636261:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c868afc7800/0x26940258de8ef0b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef0b9 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776430.636273:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c868afc7800/0x26940258de8ef0b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8ef0b9 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776430.636376:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9defb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471481216:0@lo:501: 00000100:00100000:2.0:1789776430.636435:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776430.636466:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86aa6e5900 going to sleep for 11 seconds 00000100:00100000:2.0:1789776430.636491:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471481216 00000100:00100000:2.0:1789776430.636496:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471481216 00000100:00100000:2.0:1789776430.636539:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789776430.636548:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+14:5808:x1876716471481216:12345-0@lo:501: 00000100:00100000:2.0:1789776430.636830:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+14:5808:x1876716471481216:12345-0@lo:501: Request processed in 281us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776430.636851:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789776430.636888:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9defb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471481216:0@lo:501: 00000100:00100000:2.0:1789776430.636918:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9defb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471481344:0@lo:503: 00000100:00100000:2.0:1789776430.636956:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776430.636970:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86aa6e5900 going to sleep for 11 seconds 00000100:00100000:2.0:1789776430.636981:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471481344 00000100:00100000:2.0:1789776430.636984:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471481344 00000100:00100000:2.0:1789776430.637002:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789776430.637007:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+14:5808:x1876716471481344:12345-0@lo:503: 00000100:00100000:2.0:1789776430.637162:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+14:5808:x1876716471481344:12345-0@lo:503: Request processed in 155us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776430.637170:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789776430.637205:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9defb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471481344:0@lo:503: 00000100:00100000:2.0:1789776430.637446:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9defb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8441:1876716471481472:0@lo:502: 00000100:00100000:2.0:1789776430.637479:0:8441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776430.637502:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471481472 00000100:00100000:2.0:1789776430.637506:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471481472 00000100:00100000:2.0:1789776430.637521:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789776430.637527:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+14:8441:x1876716471481472:12345-0@lo:502: 00000100:00100000:2.0:1789776430.637639:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+14:8441:x1876716471481472:12345-0@lo:502: Request processed in 111us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776430.637645:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789776430.637671:0:8441:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86aa6e5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789776430.637683:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9defb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8441:1876716471481472:0@lo:502: 00000020:01000000:2.0:1789776430.637703:0:8441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789776430.637712:0:8441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776430.637714:0:8441:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789776430.637720:0:8441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789776430.637740:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9defb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8441:1876716471481600:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789776430.637771:0:8441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776430.637788:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471481600 00000100:00100000:2.0:1789776430.637791:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471481600 00000100:00100000:2.0:1789776430.637807:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789776430.637812:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+14:8441:x1876716471481600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789776430.637907:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+14:8441:x1876716471481600:12345-0@lo:502:llog_process_th.0 Request processed in 94us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776430.637913:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789776430.637937:0:8441:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8691eed780 going to sleep for 11 seconds 00000100:00100000:2.0:1789776430.637949:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9defb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8441:1876716471481600:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789776430.637964:0:8441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789776430.637968:0:8441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776430.637970:0:8441:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789776430.637977:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1789776430.638023:0:5808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1789776430.638038:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789776430.638047:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c868afc7800/0x26940258de8ef0b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef0b9 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776430.638069:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c868afc7800/0x26940258de8ef0b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef0b9 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776430.638081:0:5808:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789776430.638083:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c86903b8800 from 39 10000000:01000000:2.0:1789776430.638086:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789776430.638112:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c868afc6200/0x26940258de8ef0c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776430.638120:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c868afc6200/0x26940258de8ef0c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776430.638129:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c868afc6200/0x26940258de8ef0c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776430.638142:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9defb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471481728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789776430.638167:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776430.638179:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8691eed780 going to sleep for 11 seconds 00000100:00100000:2.0:1789776430.638190:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471481728 00000100:00100000:2.0:1789776430.638193:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471481728 00000100:00100000:2.0:1789776430.638208:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789776430.638213:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+14:5808:x1876716471481728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789776430.638244:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776430.638257:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c868afc7a00/0x26940258de8ef0c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8ef0c0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776430.638284:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c868afc7a00/0x26940258de8ef0c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8ef0c0 expref: 15 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776430.638294:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c868afc7a00/0x26940258de8ef0c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8ef0c0 expref: 15 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776430.638303:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c868afc7a00, rc 0) 00000100:00100000:2.0:1789776430.638332:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+15:5808:x1876716471481728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776430.638338:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789776430.638365:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9defb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471481728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789776430.638376:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c868afc6200/0x26940258de8ef0c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef0c7 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776430.638386:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c868afc6200/0x26940258de8ef0c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8ef0c7 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776430.638423:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9defb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471481856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776430.638447:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776430.638458:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8691eed780 going to sleep for 11 seconds 00000100:00100000:2.0:1789776430.638468:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471481856 00000100:00100000:2.0:1789776430.638471:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471481856 00000100:00100000:2.0:1789776430.638487:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789776430.638493:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+15:5808:x1876716471481856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776430.638688:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+15:5808:x1876716471481856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 194us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776430.638706:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789776430.638735:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9defb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471481856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776430.638760:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9defb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471481984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789776430.638793:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776430.638806:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8691eed780 going to sleep for 11 seconds 00000100:00100000:2.0:1789776430.638817:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471481984 00000100:00100000:2.0:1789776430.638820:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471481984 00000100:00100000:2.0:1789776430.638836:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789776430.638842:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+15:5808:x1876716471481984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789776430.638971:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+15:5808:x1876716471481984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 128us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776430.638977:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789776430.639011:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9defb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471481984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789776430.660487:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa655f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8442:1876716471482112:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789776430.660596:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776430.660645:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86987230c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789776430.660929:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471482112 00000100:00100000:2.0:1789776430.660937:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471482112 00000100:00100000:2.0:1789776430.660992:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789776430.661028:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+15:8442:x1876716471482112:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789776430.661343:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+15:8442:x1876716471482112:12345-0@lo:502:llog_process_th.0 Request processed in 316us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776430.661352:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789776430.661463:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa655f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8442:1876716471482112:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789776430.661517:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8442:1876716471482240:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789776430.661556:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776430.661606:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86866bd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789776430.661879:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471482240 00000100:00100000:2.0:1789776430.661885:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471482240 00000100:00100000:2.0:1789776430.661923:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789776430.661932:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+15:8442:x1876716471482240:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789776430.662117:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+15:8442:x1876716471482240:12345-0@lo:502:llog_process_th.0 Request processed in 185us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776430.662124:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789776430.662200:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8442:1876716471482240:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789776430.662258:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789776430.662951:0:5808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1789776430.662972:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789776430.662983:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c868afc6200/0x26940258de8ef0c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef0c7 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776430.662995:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c868afc6200/0x26940258de8ef0c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef0c7 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776430.663006:0:5808:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789776430.663009:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1789776430.663012:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789776430.663044:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c868afc6e00/0x26940258de8ef0ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776430.663052:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c868afc6e00/0x26940258de8ef0ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776430.663074:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c868afc6e00/0x26940258de8ef0ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776430.663094:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9defb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471482368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789776430.663139:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776430.663181:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8691eed240 going to sleep for 11 seconds 00000100:00100000:1.0:1789776430.663256:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471482368 00000100:00100000:1.0:1789776430.663271:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471482368 00000100:00100000:1.0:1789776430.663306:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789776430.663314:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+15:5808:x1876716471482368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789776430.663325:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776430.663341:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c86bf5cac00/0x26940258de8ef0d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8ef0ce expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776430.663363:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c86bf5cac00/0x26940258de8ef0d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8ef0ce expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776430.663374:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c86bf5cac00/0x26940258de8ef0d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8ef0ce expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776430.663383:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86bf5cac00, rc 0) 00000100:00100000:1.0:1789776430.663416:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+16:5808:x1876716471482368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776430.663422:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789776430.663460:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9defb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471482368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789776430.663473:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c868afc6e00/0x26940258de8ef0ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef0d5 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776430.663481:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c868afc6e00/0x26940258de8ef0ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8ef0d5 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776430.663527:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471482496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789776430.663551:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776430.663584:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf30e840 going to sleep for 11 seconds 00000100:00100000:1.0:1789776430.663595:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471482496 00000100:00100000:1.0:1789776430.663606:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471482496 00000100:00100000:1.0:1789776430.663624:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789776430.663630:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+16:5808:x1876716471482496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789776430.664154:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+16:5808:x1876716471482496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 523us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776430.664161:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789776430.664312:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471482496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789776430.664343:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471482624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789776430.664379:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776430.664401:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf30e840 going to sleep for 11 seconds 00000100:00100000:1.0:1789776430.664414:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471482624 00000100:00100000:1.0:1789776430.664417:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471482624 00000100:00100000:1.0:1789776430.664437:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789776430.664443:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+16:5808:x1876716471482624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789776430.665155:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+16:5808:x1876716471482624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 710us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776430.665164:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789776430.671642:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471482624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789776430.672272:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8443:1876716471482752:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789776430.672364:0:8443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776430.672403:0:8443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8687ef79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789776430.672571:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471482752 00000100:00100000:2.0:1789776430.672585:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471482752 00000100:00100000:2.0:1789776430.672632:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789776430.672642:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+16:8443:x1876716471482752:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789776430.673185:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+16:8443:x1876716471482752:12345-0@lo:502:llog_process_th.0 Request processed in 543us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776430.673193:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789776430.673354:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8443:1876716471482752:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789776430.673386:0:8443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789776430.673395:0:8443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776430.673398:0:8443:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789776430.673403:0:8443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789776430.673430:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8443:1876716471482880:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789776430.673477:0:8443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776430.673503:0:8443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8687ef79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776430.673568:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471482880 00000100:00100000:0.0:1789776430.673573:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471482880 00000100:00100000:0.0:1789776430.673614:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789776430.673623:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa595450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+16:8443:x1876716471482880:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789776430.673788:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa595450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+16:8443:x1876716471482880:12345-0@lo:502:llog_process_th.0 Request processed in 166us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776430.673795:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789776430.674112:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8443:1876716471482880:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789776430.674135:0:8443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789776430.674142:0:8443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776430.674143:0:8443:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789776430.674146:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1789776430.674354:0:5808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1789776430.674380:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789776430.674392:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c868afc6e00/0x26940258de8ef0ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef0d5 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776430.674402:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c868afc6e00/0x26940258de8ef0ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef0d5 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776430.674412:0:5808:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789776430.674415:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c86c01a7000 from 39 10000000:01000000:2.0:1789776430.674418:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789776430.674445:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c868afc7600/0x26940258de8ef0dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776430.674453:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c868afc7600/0x26940258de8ef0dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776430.674462:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c868afc7600/0x26940258de8ef0dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776430.674478:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9dece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471483008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789776430.674510:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776430.674532:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf30e840 going to sleep for 11 seconds 00000100:00100000:0.0:1789776430.680503:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471483008 00000100:00100000:0.0:1789776430.680523:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471483008 00000100:00100000:0.0:1789776430.680602:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789776430.680611:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa597050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+16:5808:x1876716471483008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789776430.680628:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776430.680646:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c8680030600/0x26940258de8ef0e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8ef0dc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776430.680676:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c8680030600/0x26940258de8ef0e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8ef0dc expref: 17 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776430.680687:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c8680030600/0x26940258de8ef0e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8ef0dc expref: 17 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776430.680695:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8680030600, rc 0) 00000100:00100000:0.0:1789776430.680796:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa597050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+17:5808:x1876716471483008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 187us (6285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776430.680802:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789776430.680955:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9dece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471483008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789776430.680974:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c868afc7600/0x26940258de8ef0dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef0e3 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776430.680985:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c868afc7600/0x26940258de8ef0dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8ef0e3 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776430.681069:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471483136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789776430.681107:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776430.681144:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8687ef79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776430.681966:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471483136 00000100:00100000:0.0:1789776430.681973:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471483136 00000100:00100000:0.0:1789776430.682016:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789776430.682024:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa594450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+17:5808:x1876716471483136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789776430.682356:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa594450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+17:5808:x1876716471483136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 332us (1248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776430.682363:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789776430.688299:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471483136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789776430.688366:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa655f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471483264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789776430.688452:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776430.688505:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8698723480 going to sleep for 11 seconds 00000100:00100000:2.0:1789776430.688588:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471483264 00000100:00100000:2.0:1789776430.688595:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471483264 00000100:00100000:2.0:1789776430.688652:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789776430.688662:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa596c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+17:5808:x1876716471483264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789776430.688898:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa596c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+17:5808:x1876716471483264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 237us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776430.688907:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789776430.689078:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa655f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471483264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789776430.693257:0:8444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8444:1876716471483392:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789776430.693368:0:8444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776430.693431:0:8444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86af77dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789776430.693688:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471483392 00000100:00100000:2.0:1789776430.693699:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471483392 00000100:00100000:2.0:1789776430.693780:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789776430.693791:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa596450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+17:8444:x1876716471483392:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789776430.694091:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa596450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+17:8444:x1876716471483392:12345-0@lo:502:llog_process_th.0 Request processed in 302us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776430.694100:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789776430.694344:0:8444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8444:1876716471483392:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789776430.694405:0:8444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8444:1876716471483520:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789776430.694443:0:8444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776430.694475:0:8444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86af77dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776430.694528:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471483520 00000100:00100000:0.0:1789776430.694533:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471483520 00000100:00100000:0.0:1789776430.694577:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789776430.694584:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa596050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+17:8444:x1876716471483520:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789776430.694744:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa596050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+17:8444:x1876716471483520:12345-0@lo:502:llog_process_th.0 Request processed in 160us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776430.694750:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789776430.695398:0:8444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8444:1876716471483520:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789776430.695425:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789776430.695598:0:5808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1789776430.695622:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789776430.695632:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c868afc7600/0x26940258de8ef0dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef0e3 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776430.695642:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c868afc7600/0x26940258de8ef0dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef0e3 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789776430.695652:0:5808:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789776430.695655:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1789776430.695658:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789776430.695686:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8680030800/0x26940258de8ef0ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776430.695695:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c8680030800/0x26940258de8ef0ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776430.695704:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c8680030800/0x26940258de8ef0ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776430.695720:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa655c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471483648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789776430.695758:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776430.695801:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8698723d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789776430.695851:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471483648 00000100:00100000:2.0:1789776430.695857:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471483648 00000100:00100000:2.0:1789776430.695901:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789776430.695909:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa595c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+17:5808:x1876716471483648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789776430.695921:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776430.695936:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c868afc6400/0x26940258de8ef0f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8ef0ea expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776430.695960:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c868afc6400/0x26940258de8ef0f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8ef0ea expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776430.695972:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c868afc6400/0x26940258de8ef0f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8ef0ea expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776430.695992:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c868afc6400, rc 0) 00000100:00100000:2.0:1789776430.696034:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa595c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+18:5808:x1876716471483648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776430.696040:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789776430.697006:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa655c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471483648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789776430.697029:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c8680030800/0x26940258de8ef0ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef0f1 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776430.697041:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c8680030800/0x26940258de8ef0ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8ef0f1 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776430.697131:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471483776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789776430.697185:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776430.697209:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86af77dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789776430.697317:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471483776 00000100:00100000:2.0:1789776430.697323:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471483776 00000100:00100000:2.0:1789776430.697368:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789776430.697383:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa595850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+18:5808:x1876716471483776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776430.697685:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa595850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+18:5808:x1876716471483776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 303us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776430.697692:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789776430.697788:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471483776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789776430.697820:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa656680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471483904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789776430.697860:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776430.697895:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8698723300 going to sleep for 11 seconds 00000100:00100000:2.0:1789776430.698039:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471483904 00000100:00100000:2.0:1789776430.698044:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471483904 00000100:00100000:2.0:1789776430.698089:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789776430.698096:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa597850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+18:5808:x1876716471483904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789776430.698512:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa597850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+18:5808:x1876716471483904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 416us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776430.698520:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789776430.698666:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa656680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471483904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789776430.701003:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8445:1876716471484032:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789776430.701130:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776430.701186:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86af77d240 going to sleep for 11 seconds 00000100:00100000:2.0:1789776430.701584:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471484032 00000100:00100000:2.0:1789776430.701593:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471484032 00000100:00100000:2.0:1789776430.701645:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789776430.701654:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa596850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+18:8445:x1876716471484032:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789776430.701898:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa596850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+18:8445:x1876716471484032:12345-0@lo:502:llog_process_th.0 Request processed in 244us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776430.701906:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789776430.702000:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8445:1876716471484032:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789776430.702030:0:8445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789776430.702053:0:8445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776430.702063:0:8445:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789776430.702071:0:8445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789776430.702094:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8445:1876716471484160:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789776430.702142:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776430.702168:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86af77d240 going to sleep for 11 seconds 00000100:00100000:3.0:1789776430.702341:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471484160 00000100:00100000:3.0:1789776430.702345:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471484160 00000100:00100000:3.0:1789776430.702371:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789776430.702377:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa597c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+18:8445:x1876716471484160:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789776430.702549:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa597c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+18:8445:x1876716471484160:12345-0@lo:502:llog_process_th.0 Request processed in 171us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776430.702557:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789776430.702606:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8445:1876716471484160:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789776430.702627:0:8445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789776430.702632:0:8445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776430.702634:0:8445:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789776430.702637:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1789776430.702864:0:5808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1789776430.702881:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789776430.702892:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8680030800/0x26940258de8ef0ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef0f1 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776430.702902:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c8680030800/0x26940258de8ef0ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef0f1 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776430.702912:0:5808:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789776430.702916:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c86aa63b370 from 1 10000000:01000000:3.0:1789776430.702919:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789776430.705480:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c868afc7c00/0x26940258de8ef0f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776430.705501:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c868afc7c00/0x26940258de8ef0f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776430.705516:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c868afc7c00/0x26940258de8ef0f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776430.705547:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471484288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789776430.705639:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776430.705691:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86906b4300 going to sleep for 11 seconds 00000100:00100000:0.0:1789776430.705756:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471484288 00000100:00100000:0.0:1789776430.705763:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471484288 00000100:00100000:0.0:1789776430.705820:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789776430.705830:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa594850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+18:5808:x1876716471484288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789776430.705846:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776430.705862:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c8680030a00/0x26940258de8ef0ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8ef0f8 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776430.705887:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c8680030a00/0x26940258de8ef0ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8ef0f8 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776430.705897:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c8680030a00/0x26940258de8ef0ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8ef0f8 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776430.705906:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8680030a00, rc 0) 00000100:00100000:0.0:1789776430.705952:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa594850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+19:5808:x1876716471484288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776430.705974:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789776430.706552:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471484288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789776430.706587:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c868afc7c00/0x26940258de8ef0f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef0ff expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776430.706599:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c868afc7c00/0x26940258de8ef0f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8ef0ff expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776430.706680:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9ded180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471484416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776430.706717:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776430.706755:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86906b4300 going to sleep for 11 seconds 00000100:00100000:3.0:1789776430.706831:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471484416 00000100:00100000:3.0:1789776430.706838:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471484416 00000100:00100000:3.0:1789776430.706889:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789776430.706898:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa597450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+19:5808:x1876716471484416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789776430.707209:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa597450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+19:5808:x1876716471484416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 311us (490us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789776430.707241:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789776430.707490:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9ded180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471484416:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1789776430.707522:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789776430.707531:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c868afc7c00/0x26940258de8ef0f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef0ff expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776430.707540:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c868afc7c00/0x26940258de8ef0f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef0ff expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776430.999725:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789776431.351008:0:8476:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd9bfc1950 20000000:00000080:0.0:1789776431.351031:0:8476:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c86ba222800 uarg=0000000000000000 20000000:01000000:0.0:1789776431.351082:0:8476:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789776431.351088:0:8476:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789776431.351092:0:8476:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789776431.353782:0:8477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1789776431.353990:0:8476:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1789776431.362766:0:8476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1789776431.362828:0:8476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1789776431.362885:0:8476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1789776431.362904:0:8476:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789776431.362926:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c86bf5cba00/0x26940258de8ef106 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776431.362944:0:8476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c8681678a00/0x26940258de8eee7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8eee74 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776431.362953:0:8476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c868afc7000/0x26940258de8eeedd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8eeed6 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776431.362973:0:8476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c868afc6a00/0x26940258de8eefa8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8eefa1 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776431.362984:0:8476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c8680031600/0x26940258de8ef065 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c25f0 expref: 9 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776431.362992:0:8476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c86bf5cba00/0x26940258de8ef106 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776431.363036:0:8476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c8680031600/0x26940258de8ef065 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c25f0 expref: 9 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776431.363064:0:8476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c8680031600/0x26940258de8ef065 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c25f0 expref: 9 pid: 5805 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776431.363080:0:8476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8476:1876716471484544:192.168.202.6@tcp:104: 00010000:00010000:1.0:1789776431.363258:0:8476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c868afc6a00/0x26940258de8eefa8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26940258de8eefa1 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776431.363268:0:8476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c868afc6a00/0x26940258de8eefa8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26940258de8eefa1 expref: 18 pid: 5804 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776431.363277:0:8476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8476:1876716471484672:0@lo:104: 00000100:00100000:1.0:1789776431.363318:0:8476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789776431.363361:0:8476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c868afc7000/0x26940258de8eeedd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26940258de8eeed6 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776431.363370:0:8476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c868afc7000/0x26940258de8eeedd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26940258de8eeed6 expref: 18 pid: 5804 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776431.363390:0:8476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8476:1876716471484800:0@lo:104: 00000100:00100000:1.0:1789776431.363432:0:8476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789776431.364649:0:8476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c8681678a00/0x26940258de8eee7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26940258de8eee74 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776431.364662:0:8476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c8681678a00/0x26940258de8eee7b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26940258de8eee74 expref: 18 pid: 5805 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776431.364673:0:8476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8476:1876716471484928:0@lo:104: 00000100:00100000:1.0:1789776431.364810:0:8476:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bc8f69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776431.365068:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789776431.365096:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776431.365135:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471484672 00000100:00100000:0.0:1789776431.365145:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471484672 00000100:00100000:0.0:1789776431.365200:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471484800 00000100:00100000:0.0:1789776431.365203:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471484800 00000100:00100000:0.0:1789776431.365212:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471484928 00000100:00100000:0.0:1789776431.365230:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471484928 00000100:00100000:0.0:1789776431.365247:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789776431.365255:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba3be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9db43398-240e-4f78-8778-c11d527e09a1+5:8476:x1876716471484672:12345-0@lo:104: 00010000:00010000:0.0:1789776431.365268:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c8681679400/0x26940258de8eefa1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8eefa8 expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776431.365344:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789776431.365351:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba3be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9db43398-240e-4f78-8778-c11d527e09a1+5:8476:x1876716471484672:12345-0@lo:104: Request processed in 97us (2033us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776431.365358:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789776431.365377:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789776431.365383:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8691ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9db43398-240e-4f78-8778-c11d527e09a1+4:8476:x1876716471484800:12345-0@lo:104: 00010000:00010000:0.0:1789776431.365391:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c868afc7200/0x26940258de8eeed6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8eeedd expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776431.365454:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789776431.365460:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8691ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9db43398-240e-4f78-8778-c11d527e09a1+4:8476:x1876716471484800:12345-0@lo:104: Request processed in 78us (2040us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776431.365467:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789776431.365504:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789776431.365511:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa656680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9db43398-240e-4f78-8778-c11d527e09a1+3:8476:x1876716471484928:12345-0@lo:104: 00010000:00010000:0.0:1789776431.365518:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c8680030200/0x26940258de8eee74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8eee7b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776431.365550:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789776431.365556:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa656680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9db43398-240e-4f78-8778-c11d527e09a1+3:8476:x1876716471484928:12345-0@lo:104: Request processed in 46us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776431.365562:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1789776431.366019:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789776431.366027:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c8681679400/0x26940258de8eefa1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8eefa8 expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776431.366034:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681679400 already unused, calling callback (ffffffffc1da0c20) 10000000:00010000:2.0:1789776431.366039:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c8681679400/0x26940258de8eefa1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x26940258de8eefa8 expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776431.366048:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c8681679400/0x26940258de8eefa1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x26940258de8eefa8 expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776431.366065:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c8681679400/0x26940258de8eefa1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x26940258de8eefa8 expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776431.366070:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789776431.366111:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c8681679400/0x26940258de8eefa1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eefa8 expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776431.366118:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789776431.366142:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c8681679400/0x26940258de8eefa1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eefa8 expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776431.366150:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c8681679400/0x26940258de8eefa1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eefa8 expref: -99 pid: 7597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776431.366165:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789776431.366168:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c868afc7200/0x26940258de8eeed6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8eeedd expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776431.366187:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc7200 already unused, calling callback (ffffffffc1da0c20) 10000000:00010000:2.0:1789776431.366190:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c868afc7200/0x26940258de8eeed6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x26940258de8eeedd expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776431.366197:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c868afc7200/0x26940258de8eeed6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x26940258de8eeedd expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776431.366203:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c868afc7200/0x26940258de8eeed6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x26940258de8eeedd expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776431.366209:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789776431.366255:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c868afc7200/0x26940258de8eeed6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eeedd expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776431.366261:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789776431.366269:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c868afc7200/0x26940258de8eeed6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eeedd expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776431.366274:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c868afc7200/0x26940258de8eeed6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eeedd expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776431.366282:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776431.366285:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c8680030200/0x26940258de8eee74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8eee7b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776431.366291:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8680030200 already unused, calling callback (ffffffffc1da0c20) 10000000:00010000:2.0:1789776431.366294:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c8680030200/0x26940258de8eee74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26940258de8eee7b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776431.366311:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c8680030200/0x26940258de8eee74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26940258de8eee7b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776431.366317:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c8680030200/0x26940258de8eee74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26940258de8eee7b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776431.366322:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789776431.366334:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c8680030200/0x26940258de8eee74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eee7b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776431.366340:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789776431.366355:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c8680030200/0x26940258de8eee74 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eee7b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776431.366363:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c8680030200/0x26940258de8eee74 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8eee7b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776431.366378:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776431.366379:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776431.366381:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776431.366387:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776431.366401:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9ded180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471485056:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789776431.366454:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776431.366488:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789776431.366493:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471485184:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789776431.366513:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776431.366541:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9db43398-240e-4f78-8778-c11d527e09a1:3273:1876716471485312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789776431.366561:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776431.366601:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471485056 00000100:00100000:2.0:1789776431.366607:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471485056 00010000:00010000:2.0:1789776431.366631:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c868afc6a00/0x26940258de8eefa8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8eefa1 expref: 19 pid: 5804 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776431.366647:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471485184 00000100:00100000:2.0:1789776431.366650:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471485184 00010000:00010000:2.0:1789776431.366661:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c868afc7000/0x26940258de8eeedd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8eeed6 expref: 20 pid: 5804 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776431.366671:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471485312 00000100:00100000:2.0:1789776431.366673:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471485312 00010000:00010000:2.0:1789776431.366683:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c8681678a00/0x26940258de8eee7b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8eee74 expref: 21 pid: 5805 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776431.366694:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789776431.366818:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9dee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9db43398-240e-4f78-8778-c11d527e09a1+21:3275:x1876716471485056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789776431.366833:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776431.366839:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c868afc6a00/0x26940258de8eefa8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8eefa1 expref: 21 pid: 5804 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776431.366848:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c868afc6a00/0x26940258de8eefa8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26940258de8eefa1 expref: 21 pid: 5804 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776431.366867:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776431.366898:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9dee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9db43398-240e-4f78-8778-c11d527e09a1+21:3275:x1876716471485056:12345-0@lo:103:ldlm_bl.0 Request processed in 198us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776431.366904:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789776431.366921:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789776431.366927:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9ded880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9db43398-240e-4f78-8778-c11d527e09a1+20:3275:x1876716471485184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789776431.366943:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776431.366948:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c868afc7000/0x26940258de8eeedd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8eeed6 expref: 20 pid: 5804 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776431.366956:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c868afc7000/0x26940258de8eeedd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26940258de8eeed6 expref: 20 pid: 5804 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776431.366966:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776431.366988:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9ded880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9db43398-240e-4f78-8778-c11d527e09a1+20:3275:x1876716471485184:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776431.366994:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789776431.367008:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789776431.367014:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9def100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9db43398-240e-4f78-8778-c11d527e09a1+19:3273:x1876716471485312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789776431.367020:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776431.367024:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c8681678a00/0x26940258de8eee7b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8eee74 expref: 19 pid: 5805 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776431.367031:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c8681678a00/0x26940258de8eee7b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26940258de8eee74 expref: 19 pid: 5805 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776431.367040:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776431.367074:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9def100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9db43398-240e-4f78-8778-c11d527e09a1+19:3273:x1876716471485312:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776431.367080:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789776431.367117:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9db43398-240e-4f78-8778-c11d527e09a1:3273:1876716471485312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789776431.367143:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471485184:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789776431.367151:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9ded180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471485056:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789776431.367262:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776431.367292:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c868afc6a00/0x26940258de8eefa8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26940258de8eefa1 expref: 18 pid: 5804 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776431.367304:0:8476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8476:1876716471484672:0@lo:104: 00010000:00010000:1.0:1789776431.367314:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c868afc7000/0x26940258de8eeedd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26940258de8eeed6 expref: 17 pid: 5804 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776431.367322:0:8476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8476:1876716471484800:0@lo:104: 00010000:00010000:1.0:1789776431.367331:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c8681678a00/0x26940258de8eee7b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26940258de8eee74 expref: 16 pid: 5805 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776431.367339:0:8476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8476:1876716471484928:0@lo:104: 00000100:00100000:0.0:1789776431.367845:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776431.367893:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462020224 00000100:00100000:2.0:1789776431.367899:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462020224 00010000:00010000:2.0:1789776431.367921:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c8680031600/0x26940258de8ef065 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c25f0 expref: 10 pid: 5805 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776431.367954:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 24 00000100:00100000:2.0:1789776431.367961:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa654000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:2357:x1876716462020224:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789776431.367971:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776431.367975:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c8680031600/0x26940258de8ef065 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c25f0 expref: 10 pid: 5805 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776431.367985:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c8680031600/0x26940258de8ef065 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c25f0 expref: 10 pid: 5805 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776431.367999:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c86bf5cba00/0x26940258de8ef106 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776431.368007:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c86bf5cba00/0x26940258de8ef106 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776431.368022:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c86bf5cba00/0x26940258de8ef106 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776431.368030:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c86bf5cba00/0x26940258de8ef106 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776431.368036:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c86bf5cba00/0x26940258de8ef106 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776431.368043:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c86bf5cba00/0x26940258de8ef106 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776431.368068:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5cba00 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:2.0:1789776431.368072:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c86bf5cba00/0x26940258de8ef106 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776431.368080:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c86bf5cba00/0x26940258de8ef106 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776431.368089:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c86bf5cba00/0x26940258de8ef106 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776431.368099:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776431.368148:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa654000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:2357:x1876716462020224:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 187us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776431.368155:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 24 00010000:00010000:1.0:1789776431.368939:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c8680031600/0x26940258de8ef065 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c25f0 expref: 9 pid: 5805 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776431.368953:0:8476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8476:1876716471484544:192.168.202.6@tcp:104: 00010000:00010000:1.0:1789776431.368997:0:8476:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c86bf5cba00/0x26940258de8ef106 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776431.369006:0:8476:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c86bf5cba00/0x26940258de8ef106 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776431.369012:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c86bf5cba00/0x26940258de8ef106 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776431.369018:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c86bf5cba00/0x26940258de8ef106 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776431.722211:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776431.722377:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462020352 00000100:00100000:3.0:1789776431.722388:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462020352 00000100:00100000:3.0:1789776431.722450:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 169 00000100:00100000:3.0:1789776431.722462:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa594050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+9:5598:x1876716462020352:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789776431.722479:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776431.722499:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c8681679c00/0x26940258de8ef10d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c262f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776431.722529:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c8681679c00/0x26940258de8ef10d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c262f expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776431.722542:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c8681679c00/0x26940258de8ef10d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c262f expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776431.722550:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8681679c00, rc 0) 00000100:00100000:3.0:1789776431.722623:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa594050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:5598:x1876716462020352:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 163us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776431.722630:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 169 00000100:00100000:0.0:1789776431.753486:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776431.753643:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462020480 00000100:00100000:3.0:1789776431.753656:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462020480 00000100:00100000:3.0:1789776431.753735:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 170 00000100:00100000:3.0:1789776431.753764:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa595050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:5598:x1876716462020480:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789776431.754125:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa595050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:5598:x1876716462020480:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 363us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776431.754133:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 170 00000100:00100000:1.0:1789776431.760443:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776431.760560:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462020608 00000100:00100000:0.0:1789776431.760572:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462020608 00000100:00100000:0.0:1789776431.760638:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 171 00000100:00100000:0.0:1789776431.760649:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:5598:x1876716462020608:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789776431.760952:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:5598:x1876716462020608:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 Request processed in 302us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776431.760961:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 171 00000100:00100000:1.0:1789776431.768200:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776431.768346:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462020736 00000100:00100000:2.0:1789776431.768357:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462020736 00000100:00100000:2.0:1789776431.768419:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 172 00000100:00100000:2.0:1789776431.768431:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:6110:x1876716462020736:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789776431.768704:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:6110:x1876716462020736:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 268us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776431.768713:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 172 00000100:00100000:1.0:1789776431.775181:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776431.775391:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462020864 00000100:00100000:3.0:1789776431.775407:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462020864 00000100:00100000:3.0:1789776431.775472:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 173 00000100:00100000:3.0:1789776431.775484:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa594c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:6110:x1876716462020864:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789776431.775788:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa594c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:6110:x1876716462020864:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 305us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776431.775796:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 173 00010000:00010000:2.0:1789776432.020681:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776432.549540:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa654380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471485440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789776432.549635:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776432.549774:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471485440 00000100:00100000:0.0:1789776432.549782:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471485440 00000100:00100000:0.0:1789776432.549855:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789776432.549865:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471485440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789776432.549917:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789776432.549979:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471485440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776432.549987:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1789776432.550068:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86aa654380 x1876716471485440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776448 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789776432.550072:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789776432.550089:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa654380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471485440:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1789776432.597026:0:5808:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789776432.597035:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c86af31b000 from 4 10000000:01000000:2.0:1789776432.597053:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789776432.597102:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c868afc7000/0x26940258de8ef114 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776432.597129:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c868afc7000/0x26940258de8ef114 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776432.597141:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c868afc7000/0x26940258de8ef114 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776432.597168:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9ded180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471485568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789776432.597398:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776432.598085:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8682bbdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776432.598328:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471485568 00000100:00100000:1.0:1789776432.598337:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471485568 00000100:00100000:1.0:1789776432.598395:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789776432.598406:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa593c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+16:5808:x1876716471485568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789776432.598421:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776432.598437:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c86bf5cbc00/0x26940258de8ef11b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8ef114 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776432.598465:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c86bf5cbc00/0x26940258de8ef11b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8ef114 expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776432.598477:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c86bf5cbc00/0x26940258de8ef11b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8ef114 expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776432.598487:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86bf5cbc00, rc 0) 00000100:00100000:1.0:1789776432.598560:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa593c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+17:5808:x1876716471485568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (1163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776432.598566:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789776432.598736:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9ded180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471485568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789776432.598749:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c868afc7000/0x26940258de8ef114 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef11b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776432.598756:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c868afc7000/0x26940258de8ef114 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8ef11b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776432.598812:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9ded180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471485696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776432.598843:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776432.598870:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8682bbdcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776432.598980:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471485696 00000100:00100000:3.0:1789776432.598985:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471485696 00000100:00100000:3.0:1789776432.599017:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789776432.599024:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa590850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+17:5808:x1876716471485696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789776432.599485:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa590850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+17:5808:x1876716471485696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 461us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776432.599492:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789776432.599603:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9ded180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471485696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776432.599634:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9ded180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471485824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789776432.599674:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776432.599755:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8682bbdcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776432.599801:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471485824 00000100:00100000:3.0:1789776432.599811:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471485824 00000100:00100000:1.0:1789776432.599845:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789776432.599853:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+17:5808:x1876716471485824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789776432.600037:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+17:5808:x1876716471485824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 185us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776432.600054:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789776432.600431:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9ded180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471485824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789776432.601761:0:8514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8514:1876716471485952:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789776432.601826:0:8514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776432.601901:0:8514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bc8f6840 going to sleep for 11 seconds 00000100:00100000:3.0:1789776432.601940:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471485952 00000100:00100000:3.0:1789776432.601946:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471485952 00000100:00100000:3.0:1789776432.602027:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789776432.602038:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa590050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+17:8514:x1876716471485952:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789776432.604629:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa590050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+17:8514:x1876716471485952:12345-0@lo:502:llog_process_th.0 Request processed in 2585us (2794us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776432.604643:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789776432.604860:0:8514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8514:1876716471485952:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789776432.604900:0:8514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789776432.604911:0:8514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776432.604913:0:8514:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789776432.604920:0:8514:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c86af31b000 00000020:00000080:1.0:1789776432.604923:0:8514:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789776432.605023:0:8514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8514:1876716471486080:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789776432.605085:0:8514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776432.605463:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471486080 00000100:00100000:2.0:1789776432.605477:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471486080 00000100:00100000:2.0:1789776432.605527:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789776432.605536:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+17:8514:x1876716471486080:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789776432.605732:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+17:8514:x1876716471486080:12345-0@lo:502:llog_process_th.0 Request processed in 198us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776432.605738:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789776432.606080:0:8514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bc8f6840 going to sleep for 11 seconds 00000100:00100000:1.0:1789776432.606101:0:8514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8514:1876716471486080:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789776432.606133:0:8514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789776432.606140:0:8514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776432.606142:0:8514:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789776432.606147:0:8514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789776432.607619:0:5808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789776432.607646:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789776432.607657:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c868afc7000/0x26940258de8ef114 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef11b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776432.607670:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c868afc7000/0x26940258de8ef114 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef11b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776432.607681:0:5808:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789776432.607683:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c86903b8800 from 4 10000000:01000000:2.0:1789776432.607686:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789776432.607724:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c868afc6a00/0x26940258de8ef122 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776432.607731:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c868afc6a00/0x26940258de8ef122 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776432.607742:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c868afc6a00/0x26940258de8ef122 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776432.607766:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9ded180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471486208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789776432.607825:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776432.607904:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8682bbdcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776432.607954:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471486208 00000100:00100000:3.0:1789776432.607961:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471486208 00000100:00100000:3.0:1789776432.608035:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789776432.608054:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+17:5808:x1876716471486208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789776432.608067:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776432.608080:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c8681679400/0x26940258de8ef129 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8ef122 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776432.608105:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c8681679400/0x26940258de8ef129 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8ef122 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776432.608115:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c8681679400/0x26940258de8ef129 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8ef122 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776432.608125:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8681679400, rc 0) 00000100:00100000:3.0:1789776432.608414:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+18:5808:x1876716471486208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 360us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776432.608421:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789776432.608611:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9ded180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471486208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789776432.608642:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c868afc6a00/0x26940258de8ef122 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef129 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776432.608652:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c868afc6a00/0x26940258de8ef122 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8ef129 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776432.608707:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9ded180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471486336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776432.608734:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776432.608797:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8682bbdcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776432.608828:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471486336 00000100:00100000:3.0:1789776432.608832:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471486336 00000100:00100000:3.0:1789776432.608862:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789776432.608877:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa591450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+18:5808:x1876716471486336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789776432.609142:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa591450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+18:5808:x1876716471486336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 266us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776432.609149:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789776432.609388:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9ded180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471486336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776432.609417:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9ded180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471486464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789776432.609465:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776432.609480:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8682bbdcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789776432.609494:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471486464 00000100:00100000:2.0:1789776432.609497:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471486464 00000100:00100000:2.0:1789776432.609750:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1789776432.609759:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa593050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+18:5808:x1876716471486464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789776432.609930:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa593050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+18:5808:x1876716471486464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 171us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776432.609937:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789776432.610000:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9ded180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471486464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789776432.614712:0:8516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8516:1876716471486592:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789776432.614798:0:8516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776432.614838:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471486592 00000100:00100000:3.0:1789776432.614845:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471486592 00000100:00100000:3.0:1789776432.614887:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789776432.614895:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa590450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+18:8516:x1876716471486592:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789776432.615114:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa590450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+18:8516:x1876716471486592:12345-0@lo:502:llog_process_th.0 Request processed in 218us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776432.615122:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789776432.615744:0:8516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf22b840 going to sleep for 11 seconds 00000100:00100000:2.0:1789776432.616429:0:8516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8516:1876716471486592:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789776432.616472:0:8516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789776432.616482:0:8516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776432.616484:0:8516:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789776432.616491:0:8516:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c86903b8800 00000020:00000080:2.0:1789776432.616500:0:8516:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789776432.617022:0:8516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9def480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8516:1876716471486720:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789776432.617102:0:8516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776432.617142:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471486720 00000100:00100000:2.0:1789776432.617148:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471486720 00000100:00100000:2.0:1789776432.617203:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789776432.617862:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa592c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+18:8516:x1876716471486720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789776432.618102:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa592c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+18:8516:x1876716471486720:12345-0@lo:502:llog_process_th.0 Request processed in 889us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776432.618111:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789776432.619079:0:8516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8691e286c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789776432.619110:0:8516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9def480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8516:1876716471486720:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789776432.619329:0:8516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789776432.619340:0:8516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776432.619342:0:8516:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789776432.619349:0:8516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789776432.619624:0:5808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789776432.619645:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789776432.619657:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c868afc6a00/0x26940258de8ef122 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef129 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776432.619669:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c868afc6a00/0x26940258de8ef122 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef129 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776432.619679:0:5808:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789776432.619682:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c86c01a7000 from 4 10000000:01000000:1.0:1789776432.619684:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789776432.619721:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c86bf5ca200/0x26940258de8ef130 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776432.619728:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c86bf5ca200/0x26940258de8ef130 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776432.619737:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c86bf5ca200/0x26940258de8ef130 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776432.619760:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471486848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789776432.619823:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776432.619860:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bc8f6840 going to sleep for 11 seconds 00000100:00100000:2.0:1789776432.619911:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471486848 00000100:00100000:2.0:1789776432.619917:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471486848 00000100:00100000:2.0:1789776432.619955:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1789776432.619965:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+18:5808:x1876716471486848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789776432.619979:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776432.619992:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c868afc7e00/0x26940258de8ef137 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8ef130 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776432.620015:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c868afc7e00/0x26940258de8ef137 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8ef130 expref: 19 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776432.620026:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c868afc7e00/0x26940258de8ef137 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8ef130 expref: 19 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776432.620052:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c868afc7e00, rc 0) 00000100:00100000:2.0:1789776432.620131:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+19:5808:x1876716471486848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776432.620137:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789776432.624417:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471486848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789776432.624453:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c86bf5ca200/0x26940258de8ef130 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef137 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776432.624466:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c86bf5ca200/0x26940258de8ef130 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8ef137 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776432.624641:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471486976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789776432.624711:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776432.624752:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bc8f6840 going to sleep for 11 seconds 00000100:00100000:2.0:1789776432.624938:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471486976 00000100:00100000:2.0:1789776432.624945:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471486976 00000100:00100000:2.0:1789776432.624994:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1789776432.625005:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa592050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+19:5808:x1876716471486976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776432.625757:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa592050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+19:5808:x1876716471486976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 750us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776432.625765:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789776432.625943:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471486976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789776432.625984:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471487104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789776432.626030:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776432.626085:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bc8f6840 going to sleep for 11 seconds 00000100:00100000:2.0:1789776432.626610:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471487104 00000100:00100000:2.0:1789776432.626615:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471487104 00000100:00100000:2.0:1789776432.626648:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1789776432.626656:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+19:5808:x1876716471487104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789776432.626815:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+19:5808:x1876716471487104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 160us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776432.626822:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789776432.626917:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471487104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789776432.628842:0:8519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa657480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8519:1876716471487232:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789776432.628914:0:8519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776432.628952:0:8519:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86987233c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789776432.629388:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471487232 00000100:00100000:2.0:1789776432.629396:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471487232 00000100:00100000:2.0:1789776432.629451:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789776432.629462:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa591850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+19:8519:x1876716471487232:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789776432.631687:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa591850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+19:8519:x1876716471487232:12345-0@lo:502:llog_process_th.0 Request processed in 2217us (2764us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776432.631700:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1789776432.631956:0:8519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa657480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8519:1876716471487232:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789776432.631996:0:8519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789776432.632005:0:8519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776432.632008:0:8519:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789776432.632014:0:8519:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c86c01a7000 00000020:00000080:0.0:1789776432.632017:0:8519:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789776432.632123:0:8519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa657480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8519:1876716471487360:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789776432.632641:0:8519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776432.632676:0:8519:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86987233c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789776432.634764:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471487360 00000100:00100000:2.0:1789776432.634778:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471487360 00000100:00100000:2.0:1789776432.634834:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789776432.634844:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8691427450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+19:8519:x1876716471487360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789776432.635103:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8691427450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+19:8519:x1876716471487360:12345-0@lo:502:llog_process_th.0 Request processed in 260us (2462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776432.635111:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789776432.635382:0:8519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa657480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:8519:1876716471487360:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789776432.635423:0:8519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789776432.635432:0:8519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776432.635435:0:8519:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789776432.635439:0:8519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789776432.636326:0:5808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789776432.636354:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789776432.636364:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c86bf5ca200/0x26940258de8ef130 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef137 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776432.636376:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c86bf5ca200/0x26940258de8ef130 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef137 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776433.047194:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776433.559091:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3273:1876716471487744:0@lo:400:kworker.0 00000100:00100000:1.0:1789776433.559168:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776433.559387:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789776433.559394:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471487872:0@lo:400:kworker.0 00000100:00100000:1.0:1789776433.559423:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776433.559462:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471487744 00000100:00100000:1.0:1789776433.559469:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471487744 00000100:00100000:1.0:1789776433.559521:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789776433.559531:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba3bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1876716471487744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776433.559584:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba3bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1876716471487744:12345-0@lo:400:kworker.0 Request processed in 55us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776433.559591:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789776433.559614:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471487872 00000100:00100000:1.0:1789776433.559618:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471487872 00000100:00100000:1.0:1789776433.559644:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789776433.559650:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba3bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471487872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776433.559690:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba3bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471487872:12345-0@lo:400:kworker.0 Request processed in 40us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776433.559696:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1789776433.559712:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789776433.559743:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86ba3bce00 x1876716471487872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776433.559758:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471487872:0@lo:400:kworker.0 00000100:00100000:1.0:1789776433.559769:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3273:1876716471487744:0@lo:400:kworker.0 00000100:00100000:3.0:1789776433.559969:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876716471487616:0@lo:400:kworker.0 00000100:00100000:3.0:1789776433.560001:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776433.560029:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471488128:0@lo:400:kworker.0 00000100:00100000:3.0:1789776433.560062:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776433.560089:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789776433.560095:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9db43398-240e-4f78-8778-c11d527e09a1:3276:1876716471487488:0@lo:400:kworker.0 00000100:00100000:3.0:1789776433.560122:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776433.560142:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3276:1876716471488000:0@lo:400:kworker.0 00000100:00100000:3.0:1789776433.560161:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776433.560297:0:8384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471488128 00000100:00100000:3.0:1789776433.560303:0:8384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471488128 00000100:00100000:3.0:1789776433.560339:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789776433.560357:0:8384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471488128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776433.560410:0:8384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471488128:12345-0@lo:400:kworker.0 Request processed in 57us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776433.560416:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789776433.560437:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471487616 00000100:00100000:3.0:1789776433.560440:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471487616 00000100:00100000:3.0:1789776433.560459:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471488000 00000100:00100000:3.0:1789776433.560462:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471488000 00000100:00100000:3.0:1789776433.560481:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789776433.560486:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876716471487616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776433.560513:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876716471487616:12345-0@lo:400:kworker.0 Request processed in 27us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776433.560518:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789776433.560529:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789776433.560534:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876716471488000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776433.560558:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876716471488000:12345-0@lo:400:kworker.0 Request processed in 24us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776433.560563:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1789776433.560583:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789776433.560587:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789776433.560606:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3276:1876716471488000:0@lo:400:kworker.0 00000100:00100000:3.0:1789776433.560615:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876716471487616:0@lo:400:kworker.0 00010000:00080000:3.0:1789776433.560624:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86ba3be300 x1876716471488128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776433.560633:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471488128:0@lo:400:kworker.0 00000100:00100000:2.0:1789776433.560893:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471487488 00000100:00100000:2.0:1789776433.560897:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471487488 00000100:00100000:2.0:1789776433.560940:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1789776433.560947:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8691424c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+19:3276:x1876716471487488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776433.560986:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8691424c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+19:3276:x1876716471487488:12345-0@lo:400:kworker.0 Request processed in 40us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776433.560993:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789776433.561105:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9db43398-240e-4f78-8778-c11d527e09a1:3276:1876716471487488:0@lo:400:kworker.0 00010000:00010000:2.0:1789776434.068793:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776434.068957:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789776434.074546:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa657480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471488256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789776434.074626:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776434.074813:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471488256 00000100:00100000:1.0:1789776434.074822:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471488256 00000100:00100000:1.0:1789776434.074897:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789776434.074906:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471488256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789776434.074945:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789776434.075001:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471488256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776434.075008:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1789776434.075106:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86aa657480 x1876716471488256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776450 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776434.075128:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa657480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471488256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789776434.463831:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776434.463888:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776434.463925:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776434.463960:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776434.463993:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462021248 00000100:00100000:1.0:1789776434.464004:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462021248 00000100:00100000:1.0:1789776434.464096:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462021376 00000100:00100000:1.0:1789776434.464100:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462021376 00000100:00100000:1.0:1789776434.464129:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 17 00000100:00100000:1.0:1789776434.464138:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba3bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+5:2355:x1876716462021248:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1789776434.464291:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba3bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+5:2355:x1876716462021248:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 153us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776434.464299:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 17 00000100:00100000:1.0:1789776434.464317:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 18 00000100:00100000:1.0:1789776434.464324:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba3bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+5:2355:x1876716462021376:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1789776434.464353:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba3bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+5:2355:x1876716462021376:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 31us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776434.464372:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 18 00000100:00100000:2.0:1789776434.464526:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462020992 00000100:00100000:2.0:1789776434.464531:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462020992 00000100:00100000:2.0:1789776434.464565:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 190 00000100:00100000:2.0:1789776434.464572:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8691424050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:2355:x1876716462020992:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1789776434.464610:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8691424050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:2355:x1876716462020992:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 38us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776434.464616:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 190 00000100:00100000:0.0:1789776434.464717:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462021120 00000100:00100000:0.0:1789776434.464722:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462021120 00000100:00100000:0.0:1789776434.464765:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 33 00000100:00100000:0.0:1789776434.464773:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba3bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+6:2355:x1876716462021120:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1789776434.464811:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba3bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+6:2355:x1876716462021120:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 40us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776434.464817:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 33 00000100:00080000:3.0:1789776434.465065:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789776434.465071:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789776434.465074:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789776435.111636:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776436.118665:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776437.141391:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776437.653587:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789776437.653615:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa654a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471488384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789776437.653689:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776437.654307:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471488384 00000100:00100000:0.0:1789776437.654316:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471488384 00000100:00100000:0.0:1789776437.654385:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789776437.654396:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9def480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471488384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789776437.654432:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789776437.654486:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9def480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471488384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776437.654494:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1789776437.654558:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789776437.654595:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86aa654a80 x1876716471488384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776453 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776437.654616:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa654a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471488384:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1789776437.803030:0:8776:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1789776438.166156:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776438.678947:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471488512:0@lo:400:kworker.0 00000100:00100000:0.0:1789776438.679042:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776438.679105:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9dece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3275:1876716471489024:0@lo:400:kworker.0 00000100:00100000:0.0:1789776438.679133:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776438.679157:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789776438.679163:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3275:1876716471488640:0@lo:400:kworker.0 00000100:00100000:0.0:1789776438.679203:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776438.679245:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471489152:0@lo:400:kworker.0 00000100:00100000:0.0:1789776438.679266:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776438.679297:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471489024 00000100:00100000:0.0:1789776438.679305:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471489024 00000100:00100000:0.0:1789776438.679353:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471488640 00000100:00100000:0.0:1789776438.679357:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471488640 00000100:00100000:0.0:1789776438.679377:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789776438.679385:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa655880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1876716471489024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776438.679509:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa655880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1876716471489024:12345-0@lo:400:kworker.0 Request processed in 124us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776438.679517:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789776438.679533:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789776438.679539:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa654a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1876716471488640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776438.679565:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa654a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1876716471488640:12345-0@lo:400:kworker.0 Request processed in 26us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776438.679571:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1789776438.679711:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789776438.679750:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3275:1876716471488640:0@lo:400:kworker.0 00000100:00100000:0.0:1789776438.679761:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9dece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3275:1876716471489024:0@lo:400:kworker.0 00000100:00100000:2.0:1789776438.679986:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471488512 00000100:00100000:2.0:1789776438.680001:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471488512 00000100:00100000:2.0:1789776438.680033:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789776438.680039:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86c2071450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+19:3275:x1876716471488512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776438.680075:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86c2071450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+19:3275:x1876716471488512:12345-0@lo:400:kworker.0 Request processed in 36us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776438.680082:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789776438.680291:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3273:1876716471488768:0@lo:400:kworker.0 00000100:00100000:1.0:1789776438.680321:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776438.680354:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789776438.680360:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9ded180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471488896:0@lo:400:kworker.0 00000100:00100000:1.0:1789776438.680381:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776438.680548:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471489152 00000100:00100000:3.0:1789776438.680553:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471489152 00000100:00100000:3.0:1789776438.680771:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471488896 00000100:00100000:3.0:1789776438.680775:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471488896 00000100:00100000:3.0:1789776438.680797:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789776438.680804:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa657480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471489152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776438.680844:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa657480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471489152:12345-0@lo:400:kworker.0 Request processed in 40us (1575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776438.680850:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789776438.680864:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789776438.680871:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba3bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471488896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776438.680898:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba3bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471488896:12345-0@lo:400:kworker.0 Request processed in 27us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776438.680904:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1789776438.680927:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789776438.681038:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86b9ded180 x1876716471488896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776438.681051:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9ded180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471488896:0@lo:400:kworker.0 00010000:00080000:0.0:1789776438.681206:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86b9defb80 x1876716471489152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776438.681246:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471489152:0@lo:400:kworker.0 00000100:00100000:0.0:1789776438.681258:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471488512:0@lo:400:kworker.0 00000100:00100000:2.0:1789776438.681538:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471488768 00000100:00100000:2.0:1789776438.681543:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471488768 00000100:00100000:2.0:1789776438.681753:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789776438.681762:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba3be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1876716471488768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776438.681814:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba3be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1876716471488768:12345-0@lo:400:kworker.0 Request processed in 54us (1492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776438.681820:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789776438.681928:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3273:1876716471488768:0@lo:400:kworker.0 00000100:00080000:3.0:1789776438.681979:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789776439.188464:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776439.188833:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa654380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471489280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789776439.188905:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776439.189162:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471489280 00000100:00100000:0.0:1789776439.189171:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471489280 00000100:00100000:0.0:1789776439.189251:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789776439.189260:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba3bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471489280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789776439.189296:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789776439.189343:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba3bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471489280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776439.189351:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1789776439.189469:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86aa654380 x1876716471489280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776455 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776439.189489:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa654380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471489280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789776439.584348:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776439.584420:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776439.584457:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776439.584496:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462021760 00000100:00100000:3.0:1789776439.584507:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462021760 00000100:00100000:1.0:1789776439.584507:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776439.584579:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462021888 00000100:00100000:3.0:1789776439.584583:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462021888 00000100:00100000:2.0:1789776439.584595:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462021504 00000100:00100000:2.0:1789776439.584602:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462021504 00000100:00100000:3.0:1789776439.584613:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 21 00000100:00100000:3.0:1789776439.584626:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0795fb8a-e14a-4768-806c-f332ad101de7+5:2357:x1876716462021760:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1789776439.584641:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 192 00000100:00100000:2.0:1789776439.584651:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:2357:x1876716462021504:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1789776439.584736:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462021632 00000100:00100000:0.0:1789776439.584741:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462021632 00000100:00100000:0.0:1789776439.584777:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 37 00000100:00100000:0.0:1789776439.584785:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+6:2357:x1876716462021632:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1789776439.584845:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:2357:x1876716462021504:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 196us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776439.584853:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 192 00000100:00100000:1.0:1789776439.585035:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 22 00000100:00100000:1.0:1789776439.585046:0:8384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf299180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0795fb8a-e14a-4768-806c-f332ad101de7+5:2357:x1876716462021888:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1789776439.585789:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0795fb8a-e14a-4768-806c-f332ad101de7+5:2357:x1876716462021760:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 1164us (1365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776439.585799:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 21 00000100:00080000:3.0:1789776439.585831:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789776439.585836:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789776439.585839:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789776439.587610:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+6:2357:x1876716462021632:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 2818us (3144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776439.587623:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 37 00000100:00100000:1.0:1789776439.588122:0:8384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf299180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0795fb8a-e14a-4768-806c-f332ad101de7+5:2357:x1876716462021888:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 3076us (3613us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776439.588133:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 22 00010000:00010000:2.0:1789776440.212460:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776441.243340:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776442.260516:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776442.772875:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9dec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471489408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789776442.773017:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776442.773115:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471489408 00000100:00100000:1.0:1789776442.773123:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471489408 00000100:00100000:1.0:1789776442.773185:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789776442.773194:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471489408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789776442.773249:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789776442.775793:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471489408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2591us (2768us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776442.775805:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1789776442.775927:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86b9dec380 x1876716471489408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776458 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776442.775949:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9dec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471489408:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789776442.776002:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1789776443.279011:0:9021:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing yml_node 00010000:00010000:0.0:1789776443.291899:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776443.800290:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa655c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471489536:0@lo:400:kworker.0 00000100:00100000:0.0:1789776443.800363:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776443.800411:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c8582a71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3275:1876716471490048:0@lo:400:kworker.0 00000100:00100000:0.0:1789776443.800493:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776443.800520:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789776443.800526:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3275:1876716471489664:0@lo:400:kworker.0 00000100:00100000:0.0:1789776443.800573:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776443.800591:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c8582a72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471490176:0@lo:400:kworker.0 00000100:00100000:0.0:1789776443.803200:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776443.803281:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa654380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3273:1876716471489792:0@lo:400:kworker.0 00000100:00100000:0.0:1789776443.803309:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776443.803334:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789776443.803342:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c8582a70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471489920:0@lo:400:kworker.0 00000100:00100000:0.0:1789776443.803366:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776443.803402:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471489536 00000100:00100000:0.0:1789776443.803411:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471489536 00000100:00100000:0.0:1789776443.803461:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789776443.803472:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+19:3275:x1876716471489536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776443.803526:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+19:3275:x1876716471489536:12345-0@lo:400:kworker.0 Request processed in 56us (3163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776443.803533:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789776443.803565:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471490048 00000100:00100000:0.0:1789776443.803569:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471490048 00000100:00100000:0.0:1789776443.803601:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471489664 00000100:00100000:0.0:1789776443.803605:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471489664 00000100:00100000:0.0:1789776443.803616:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471489792 00000100:00100000:0.0:1789776443.803618:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471489792 00000100:00100000:0.0:1789776443.803631:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789776443.803636:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1876716471490048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776443.803667:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1876716471490048:12345-0@lo:400:kworker.0 Request processed in 31us (3174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776443.803672:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789776443.803685:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789776443.803690:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1876716471489664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776443.805168:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1876716471489664:12345-0@lo:400:kworker.0 Request processed in 1469us (4586us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776443.805186:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789776443.805211:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789776443.805235:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1876716471489792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776443.805285:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1876716471489792:12345-0@lo:400:kworker.0 Request processed in 55us (1976us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776443.805291:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789776443.805316:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471490176 00000100:00100000:0.0:1789776443.805322:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471490176 00000100:00100000:0.0:1789776443.805353:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471489920 00000100:00100000:0.0:1789776443.805357:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471489920 00000100:00100000:0.0:1789776443.805377:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789776443.805383:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471490176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776443.805412:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471490176:12345-0@lo:400:kworker.0 Request processed in 30us (2216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776443.805418:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789776443.805429:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789776443.805434:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471489920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776443.805460:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471489920:12345-0@lo:400:kworker.0 Request processed in 26us (2094us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776443.805465:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1789776443.805491:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789776443.805495:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789776443.805532:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c8582a70380 x1876716471489920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776443.805547:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c8582a70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471489920:0@lo:400:kworker.0 00000100:00100000:0.0:1789776443.805560:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa654380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3273:1876716471489792:0@lo:400:kworker.0 00000100:00100000:0.0:1789776443.805611:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3275:1876716471489664:0@lo:400:kworker.0 00010000:00080000:0.0:1789776443.805622:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c8582a72680 x1876716471490176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776443.805630:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c8582a72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471490176:0@lo:400:kworker.0 00000100:00100000:0.0:1789776443.805640:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa655c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471489536:0@lo:400:kworker.0 00000100:00100000:0.0:1789776443.805651:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c8582a71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3275:1876716471490048:0@lo:400:kworker.0 00010000:00010000:2.0:1789776444.314201:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776444.316463:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9ded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471490304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789776444.316907:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776444.318091:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471490304 00000100:00100000:2.0:1789776444.318113:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471490304 00000100:00100000:2.0:1789776444.318185:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789776444.318196:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471490304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789776444.318253:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789776444.318319:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471490304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (1412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776444.318327:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1789776444.318377:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86b9ded500 x1876716471490304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776460 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776444.318398:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9ded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471490304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789776444.707895:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776444.707973:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776444.708015:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776444.708119:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776444.708273:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462022144 00000100:00100000:1.0:1789776444.708284:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462022144 00000100:00100000:1.0:1789776444.708353:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 41 00000100:00100000:1.0:1789776444.708364:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+6:2357:x1876716462022144:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1789776444.708438:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+6:2357:x1876716462022144:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 76us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776444.708445:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 41 00000100:00080000:1.0:1789776444.708603:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789776444.708737:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462022016 00000100:00100000:2.0:1789776444.708742:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462022016 00000100:00100000:2.0:1789776444.708782:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 194 00000100:00100000:2.0:1789776444.708790:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:2357:x1876716462022016:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1789776444.708823:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:2357:x1876716462022016:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 35us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776444.708829:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 194 00000100:00100000:3.0:1789776444.719052:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462022272 00000100:00100000:3.0:1789776444.719068:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462022272 00000100:00100000:3.0:1789776444.719159:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462022400 00000100:00100000:3.0:1789776444.719163:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462022400 00000100:00100000:3.0:1789776444.719199:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00100000:3.0:1789776444.719208:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0795fb8a-e14a-4768-806c-f332ad101de7+5:2353:x1876716462022272:12345-192.168.202.6@tcp:9:kworker.0 00000020:00000080:3.0:1789776444.719258:0:6659:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x26940258de8ef073 00000100:00080000:3.0:1789776444.719280:0:6659:0:(import.c:65:import_set_state_nolock()) ffff9c86c0243000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789776444.719318:0:6659:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1789776444.719886:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 11 00000100:00100000:2.0:1789776444.719897:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+5:2353:x1876716462022400:12345-192.168.202.6@tcp:9:kworker.0 00000020:00000080:2.0:1789776444.719918:0:6661:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x26940258de8ef07a 00000100:00080000:2.0:1789776444.719924:0:6661:0:(import.c:65:import_set_state_nolock()) ffff9c86c0245800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789776444.719959:0:6661:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1789776444.720235:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+2:2353:x1876716462022400:12345-192.168.202.6@tcp:9:kworker.0 Request processed in 319us (12094us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776444.720252:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 11 00010000:00010000:2.0:1789776444.720279:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776444.720446:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776444.720916:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0795fb8a-e14a-4768-806c-f332ad101de7+2:2353:x1876716462022272:12345-192.168.202.6@tcp:9:kworker.0 Request processed in 1705us (12897us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776444.720925:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00080000:0.0:1789776444.722864:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789776444.722873:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789776445.332722:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776446.356836:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776447.380904:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776447.892768:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789776447.892794:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9ded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471490432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789776447.892866:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776447.893648:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471490432 00000100:00100000:2.0:1789776447.893658:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471490432 00000100:00100000:2.0:1789776447.893738:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789776447.893748:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471490432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789776447.893791:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789776447.894000:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789776447.894441:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471490432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 693us (1574us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776447.894449:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1789776447.899776:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86b9ded500 x1876716471490432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776463 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776447.899808:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9ded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471490432:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789776448.404578:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789776448.488848:0:7615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0795fb8a-e14a-4768-806c-f332ad101de7 00000020:00000080:0.0:1789776448.488859:0:7615:0:(genops.c:885:class_export_put()) final put ffff9c86c0240800/0795fb8a-e14a-4768-806c-f332ad101de7 00000020:00000080:0.0:1789776448.488885:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c86c0240800/0795fb8a-e14a-4768-806c-f332ad101de7 for lustre-OST0001 00000020:00000080:0.0:1789776448.488947:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c86c0245800 for lustre-OST0001 00000001:02000400:3.0:1789776448.917844:0:9215:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.111 00000100:00100000:1.0:1789776448.919782:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf29b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471490560:0@lo:400:kworker.0 00000100:00100000:1.0:1789776448.919884:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776448.919954:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf29b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3275:1876716471491072:0@lo:400:kworker.0 00000100:00100000:1.0:1789776448.919987:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776448.920020:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789776448.920026:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf298a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3275:1876716471490688:0@lo:400:kworker.0 00000100:00100000:1.0:1789776448.920050:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776448.920070:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf29aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471491200:0@lo:400:kworker.0 00000100:00100000:1.0:1789776448.920097:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776448.920138:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf29a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3273:1876716471490816:0@lo:400:kworker.0 00000100:00100000:1.0:1789776448.920163:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776448.920182:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789776448.920187:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf299880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471490944:0@lo:400:kworker.0 00000100:00100000:1.0:1789776448.920210:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776448.920280:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471490560 00000100:00100000:1.0:1789776448.920289:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471490560 00000100:00100000:1.0:1789776448.920348:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789776448.920358:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+19:3275:x1876716471490560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776448.920420:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+19:3275:x1876716471490560:12345-0@lo:400:kworker.0 Request processed in 63us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776448.920428:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789776448.920468:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471491072 00000100:00100000:1.0:1789776448.920473:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471491072 00000100:00100000:1.0:1789776448.920513:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471490688 00000100:00100000:1.0:1789776448.920516:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471490688 00000100:00100000:1.0:1789776448.920531:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471490816 00000100:00100000:1.0:1789776448.920533:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471490816 00000100:00100000:1.0:1789776448.920572:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789776448.920579:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf299f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1876716471491072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776448.920616:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf299f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1876716471491072:12345-0@lo:400:kworker.0 Request processed in 38us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776448.920622:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789776448.920635:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789776448.920641:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf29b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1876716471490688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776448.920669:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf29b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1876716471490688:12345-0@lo:400:kworker.0 Request processed in 28us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776448.920675:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789776448.920688:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789776448.920694:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf29ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1876716471490816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776448.920727:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf29ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1876716471490816:12345-0@lo:400:kworker.0 Request processed in 32us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776448.920733:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789776448.920757:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471491200 00000100:00100000:1.0:1789776448.920761:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471491200 00000100:00100000:1.0:1789776448.920791:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471490944 00000100:00100000:1.0:1789776448.920795:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471490944 00000100:00100000:1.0:1789776448.920814:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789776448.920821:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf298000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471491200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776448.920853:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf298000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471491200:12345-0@lo:400:kworker.0 Request processed in 33us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776448.920860:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789776448.920871:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789776448.920878:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf298380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471490944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776448.920939:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf298380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471490944:12345-0@lo:400:kworker.0 Request processed in 61us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776448.920946:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1789776448.920978:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789776448.920984:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789776448.921032:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bf299880 x1876716471490944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776448.921048:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf299880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471490944:0@lo:400:kworker.0 00000100:00100000:1.0:1789776448.921063:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf29a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3273:1876716471490816:0@lo:400:kworker.0 00000100:00100000:1.0:1789776448.921102:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf298a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3275:1876716471490688:0@lo:400:kworker.0 00010000:00080000:1.0:1789776448.921114:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bf29aa00 x1876716471491200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776448.921123:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf29aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471491200:0@lo:400:kworker.0 00000100:00100000:1.0:1789776448.921131:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf29b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471490560:0@lo:400:kworker.0 00000100:00100000:1.0:1789776448.921141:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf29b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3275:1876716471491072:0@lo:400:kworker.0 00000001:00100000:2.0:1789776449.013308:0:6684:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0795fb8a-e14a-4768-806c-f332ad101de7 00000020:00000080:2.0:1789776449.013322:0:6684:0:(genops.c:885:class_export_put()) final put ffff9c86c0244800/0795fb8a-e14a-4768-806c-f332ad101de7 00000020:00000080:3.0:1789776449.013446:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c86c0244800/0795fb8a-e14a-4768-806c-f332ad101de7 for lustre-OST0000 00000020:00000080:3.0:1789776449.013506:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c86c0243000 for lustre-OST0000 00000100:00100000:0.0:1789776449.428889:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789776449.428935:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9dee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471491328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789776449.429056:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776449.429418:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471491328 00000100:00100000:2.0:1789776449.429429:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471491328 00000100:00100000:2.0:1789776449.429500:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789776449.429512:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471491328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789776449.429561:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789776449.429617:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471491328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776449.429626:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1789776449.432099:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86b9dee680 x1876716471491328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776465 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776449.432137:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9dee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471491328:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789776449.432550:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776449.820840:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776449.820913:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776449.820958:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462022656 00000100:00100000:2.0:1789776449.820982:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462022656 00000100:00100000:2.0:1789776449.821064:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 45 00000100:00100000:2.0:1789776449.821076:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9dedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+6:2357:x1876716462022656:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1789776449.821196:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9dedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+6:2357:x1876716462022656:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 122us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776449.821205:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 45 00000100:00080000:2.0:1789776449.821268:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789776449.821463:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462022528 00000100:00100000:3.0:1789776449.821470:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462022528 00000100:00100000:3.0:1789776449.821512:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 196 00000100:00100000:3.0:1789776449.821520:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:2357:x1876716462022528:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1789776449.821563:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:2357:x1876716462022528:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 44us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776449.821570:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 196 00010000:00010000:2.0:1789776450.452537:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789776451.356047:0:9313:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.111 00010000:00010000:2.0:1789776451.476343:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776452.500773:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776453.028074:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9dee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471491456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789776453.028190:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776453.028369:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471491456 00000100:00100000:2.0:1789776453.028381:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471491456 00000100:00100000:2.0:1789776453.028464:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789776453.028476:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471491456:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789776453.028486:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1789776453.028535:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789776453.028603:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471491456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776453.028611:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1789776453.028674:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86b9dee680 x1876716471491456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776469 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776453.028694:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9dee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471491456:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789776453.524990:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789776453.644859:0:9412:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.111 00000100:00100000:0.0:1789776454.037251:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c8582a71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3273:1876716471491840:0@lo:400:kworker.0 00000100:00100000:1.0:1789776454.037399:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c8582a73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471491968:0@lo:400:kworker.0 00000100:00100000:1.0:1789776454.037479:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776454.037566:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471491968 00000100:00100000:1.0:1789776454.037574:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471491968 00000100:00100000:1.0:1789776454.037625:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789776454.037635:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf29b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471491968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776454.037688:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf29b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471491968:12345-0@lo:400:kworker.0 Request processed in 54us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776454.037695:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1789776454.037737:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c8582a73800 x1876716471491968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776454.037752:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c8582a73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471491968:0@lo:400:kworker.0 00000100:00100000:1.0:1789776454.037801:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c8582a72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876716471491712:0@lo:400:kworker.0 00000100:00100000:1.0:1789776454.037829:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776454.037861:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c8582a72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471492224:0@lo:400:kworker.0 00000100:00100000:1.0:1789776454.037892:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776454.037911:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789776454.037916:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c8582a73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9db43398-240e-4f78-8778-c11d527e09a1:3276:1876716471491584:0@lo:400:kworker.0 00000100:00100000:1.0:1789776454.037943:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776454.037965:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c8582a70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3276:1876716471492096:0@lo:400:kworker.0 00000100:00100000:1.0:1789776454.037987:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776454.038013:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471491712 00000100:00100000:1.0:1789776454.038016:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471491712 00000100:00100000:1.0:1789776454.038042:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471492096 00000100:00100000:1.0:1789776454.038046:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471492096 00000100:00100000:1.0:1789776454.038071:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789776454.038078:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf29b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876716471491712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776454.038124:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf29b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876716471491712:12345-0@lo:400:kworker.0 Request processed in 46us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776454.038137:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789776454.038151:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789776454.038157:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876716471492096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776454.038187:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876716471492096:12345-0@lo:400:kworker.0 Request processed in 30us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776454.038192:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789776454.038209:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471492224 00000100:00100000:1.0:1789776454.038213:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471492224 00000100:00100000:1.0:1789776454.038263:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1789776454.038987:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789776454.038994:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789776454.039008:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471491584 00000100:00100000:2.0:1789776454.039012:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471491584 00000100:00100000:2.0:1789776454.039046:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1789776454.039054:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+19:3276:x1876716471491584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776454.039105:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+19:3276:x1876716471491584:12345-0@lo:400:kworker.0 Request processed in 52us (1161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776454.039111:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1789776454.039166:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c8582a73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9db43398-240e-4f78-8778-c11d527e09a1:3276:1876716471491584:0@lo:400:kworker.0 00000100:00100000:2.0:1789776454.039191:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c8582a70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3276:1876716471492096:0@lo:400:kworker.0 00000100:00100000:2.0:1789776454.039201:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c8582a72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876716471491712:0@lo:400:kworker.0 00000100:00100000:0.0:1789776454.039329:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776454.039365:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471491840 00000100:00100000:0.0:1789776454.039368:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471491840 00000100:00100000:0.0:1789776454.039399:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789776454.039406:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1876716471491840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776454.039441:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1876716471491840:12345-0@lo:400:kworker.0 Request processed in 36us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776454.039459:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1789776454.039476:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789776454.039492:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c8582a71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3273:1876716471491840:0@lo:400:kworker.0 00000100:00100000:1.0:1789776454.040383:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf29aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471492224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776454.040439:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf29aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471492224:12345-0@lo:400:kworker.0 Request processed in 65us (2546us total) trans 0 rc 0/0 00010000:00080000:0.0:1789776454.041262:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c8582a72d80 x1876716471492224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776454.041287:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c8582a72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471492224:0@lo:400:kworker.0 00000100:00100000:1.0:1789776454.046059:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789776454.548509:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789776454.548534:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9ded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471492352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789776454.548605:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776454.548674:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471492352 00000100:00100000:2.0:1789776454.548683:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471492352 00000100:00100000:2.0:1789776454.548731:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789776454.548740:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9dec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471492352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789776454.548779:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789776454.548825:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9dec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471492352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776454.548832:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1789776454.548883:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86b9ded500 x1876716471492352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776470 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776454.548901:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9ded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471492352:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789776454.553012:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776454.944972:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776454.945072:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776454.945783:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462022912 00000100:00100000:3.0:1789776454.945795:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462022912 00000100:00100000:3.0:1789776454.945908:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 49 00000100:00100000:3.0:1789776454.945919:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9ded500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+6:2357:x1876716462022912:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1789776454.946000:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9ded500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+6:2357:x1876716462022912:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 83us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776454.946009:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 49 00000100:00080000:2.0:1789776454.947041:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789776454.950744:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462022784 00000100:00100000:1.0:1789776454.950760:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462022784 00000100:00100000:1.0:1789776454.950878:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 198 00000100:00100000:1.0:1789776454.950890:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:2357:x1876716462022784:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1789776454.950978:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:2357:x1876716462022784:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 91us (6018us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776454.950986:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 198 00000001:02000400:2.0:1789776455.244523:0:9460:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Sep 18 20:07:34 EDT 2026 00010000:00010000:2.0:1789776455.572391:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776456.596959:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776457.620851:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776458.135468:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471492480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789776458.135574:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776458.136298:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471492480 00000100:00100000:0.0:1789776458.136323:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471492480 00000100:00100000:0.0:1789776458.136409:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789776458.136422:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471492480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789776458.136472:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789776458.136633:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789776458.136656:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471492480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 236us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776458.136664:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1789776458.136722:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86b9dedf80 x1876716471492480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776474 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776458.136745:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471492480:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789776458.646480:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776459.157160:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471492608:0@lo:400:kworker.0 00000100:00100000:3.0:1789776459.157273:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776459.157498:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876716471492736:0@lo:400:kworker.0 00000100:00100000:0.0:1789776459.157550:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776459.157595:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471492736 00000100:00100000:0.0:1789776459.157603:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471492736 00000100:00100000:0.0:1789776459.157647:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789776459.157657:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876716471492736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776459.157708:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876716471492736:12345-0@lo:400:kworker.0 Request processed in 51us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776459.157715:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789776459.157758:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876716471492736:0@lo:400:kworker.0 00000100:00100000:1.0:1789776459.157804:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471492608 00000100:00100000:1.0:1789776459.157808:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471492608 00000100:00100000:1.0:1789776459.157861:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789776459.157869:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+19:3275:x1876716471492608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776459.166972:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+19:3275:x1876716471492608:12345-0@lo:400:kworker.0 Request processed in 9093us (9688us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776459.166997:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789776459.170065:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9dece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471492992:0@lo:400:kworker.0 00000100:00100000:1.0:1789776459.170141:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776459.170180:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789776459.170187:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9ded180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3274:1876716471492864:0@lo:400:kworker.0 00000100:00100000:0.0:1789776459.170196:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471493248:0@lo:400:kworker.0 00000100:00100000:1.0:1789776459.170212:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776459.170244:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776459.170274:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789776459.170280:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471492992 00000100:00100000:0.0:1789776459.170280:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3276:1876716471493120:0@lo:400:kworker.0 00000100:00100000:1.0:1789776459.170286:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471492992 00000100:00100000:0.0:1789776459.170301:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776459.170327:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471493248 00000100:00100000:1.0:1789776459.170330:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471493248 00000100:00100000:0.0:1789776459.170359:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789776459.170369:0:8384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf29a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471492992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776459.170500:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471492608:0@lo:400:kworker.0 00000100:00100000:3.0:1789776459.170540:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471492864 00000100:00100000:3.0:1789776459.170544:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471492864 00000100:00100000:1.0:1789776459.170647:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789776459.170654:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471493248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776459.170693:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471493248:12345-0@lo:400:kworker.0 Request processed in 39us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776459.170700:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789776459.170799:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471493120 00000100:00100000:2.0:1789776459.170804:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471493120 00000100:00100000:0.0:1789776459.178617:0:8384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf29a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471492992:12345-0@lo:400:kworker.0 Request processed in 8239us (8465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776459.178634:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1789776459.179242:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86b9defb80 x1876716471493248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776459.179258:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471493248:0@lo:400:kworker.0 00010000:00080000:0.0:1789776459.180012:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86b9dece00 x1876716471492992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776459.180025:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9dece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471492992:0@lo:400:kworker.0 00000100:00100000:3.0:1789776459.180561:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789776459.180573:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1876716471492864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776459.180659:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1876716471492864:12345-0@lo:400:kworker.0 Request processed in 89us (10446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776459.180665:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789776459.180703:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9ded180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3274:1876716471492864:0@lo:400:kworker.0 00000100:00080000:1.0:1789776459.182078:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789776459.182087:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789776459.182684:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789776459.182697:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876716471493120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776459.182776:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876716471493120:12345-0@lo:400:kworker.0 Request processed in 83us (12473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776459.182783:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789776459.183522:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3276:1876716471493120:0@lo:400:kworker.0 00010000:00010000:1.0:1789776459.676547:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776459.678091:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789776459.678123:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf299500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471493376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789776459.678240:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776459.678318:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471493376 00000100:00100000:2.0:1789776459.678327:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471493376 00000100:00100000:2.0:1789776459.678379:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789776459.678388:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471493376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789776459.678422:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789776459.678468:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471493376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776459.678476:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1789776459.678517:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bf299500 x1876716471493376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776475 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776459.678537:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf299500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471493376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789776460.065612:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776460.065699:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776460.066868:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462023040 00000100:00100000:1.0:1789776460.066881:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462023040 00000100:00100000:1.0:1789776460.066941:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 200 00000100:00100000:1.0:1789776460.066952:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:2356:x1876716462023040:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1789776460.067022:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:2356:x1876716462023040:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 73us (1323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776460.067028:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 200 00000100:00100000:3.0:1789776460.069170:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462023168 00000100:00100000:3.0:1789776460.069182:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462023168 00000100:00100000:3.0:1789776460.069255:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 53 00000100:00100000:3.0:1789776460.069264:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9dee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+6:2356:x1876716462023168:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1789776460.069330:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9dee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+6:2356:x1876716462023168:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 69us (3730us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776460.069336:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 53 00000100:00080000:1.0:1789776460.069396:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789776460.692382:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776461.718983:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776462.741402:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776463.255922:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471493504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789776463.256000:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776463.256119:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471493504 00000100:00100000:2.0:1789776463.256128:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471493504 00000100:00100000:2.0:1789776463.256247:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789776463.256258:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471493504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789776463.256293:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789776463.256361:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471493504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776463.256369:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1789776463.257764:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789776463.257896:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86b9deea00 x1876716471493504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776479 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776463.257920:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471493504:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789776463.771263:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776464.276963:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471494016:0@lo:400:kworker.0 00000100:00100000:0.0:1789776464.277032:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776464.277096:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789776464.277102:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa654380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3274:1876716471493888:0@lo:400:kworker.0 00000100:00100000:0.0:1789776464.277130:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776464.277149:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa655c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471493632:0@lo:400:kworker.0 00000100:00100000:0.0:1789776464.277166:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471494016 00000100:00100000:0.0:1789776464.277174:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471494016 00000100:00100000:3.0:1789776464.277194:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776464.277252:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789776464.277253:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3275:1876716471494144:0@lo:400:kworker.0 00000100:00100000:0.0:1789776464.277265:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471494016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776464.277284:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776464.277312:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789776464.277319:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3275:1876716471493760:0@lo:400:kworker.0 00000100:00100000:0.0:1789776464.277328:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471494016:12345-0@lo:400:kworker.0 Request processed in 66us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776464.277346:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789776464.277352:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776464.277375:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471494272:0@lo:400:kworker.0 00000100:00100000:0.0:1789776464.277376:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471493888 00000100:00100000:0.0:1789776464.277382:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471493888 00000100:00100000:3.0:1789776464.277407:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776464.277417:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471494144 00000100:00100000:0.0:1789776464.277421:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471494144 00000100:00100000:0.0:1789776464.277457:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471493760 00000100:00100000:0.0:1789776464.277461:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471493760 00000100:00100000:3.0:1789776464.277473:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789776464.277488:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789776464.277496:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1876716471494144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776464.277534:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1876716471494144:12345-0@lo:400:kworker.0 Request processed in 39us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776464.277540:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789776464.277553:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789776464.277559:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1876716471493760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776464.277583:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1876716471493760:12345-0@lo:400:kworker.0 Request processed in 24us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776464.277588:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789776464.277604:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471494272 00000100:00100000:0.0:1789776464.277607:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471494272 00000100:00100000:0.0:1789776464.277630:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789776464.277636:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471494272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776464.277664:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471494272:12345-0@lo:400:kworker.0 Request processed in 28us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776464.277670:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1789776464.277688:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789776464.277692:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789776464.277850:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1876716471493888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776464.277894:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1876716471493888:12345-0@lo:400:kworker.0 Request processed in 50us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776464.277901:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789776464.277994:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa654380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3274:1876716471493888:0@lo:400:kworker.0 00010000:00080000:0.0:1789776464.278017:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bf7a9500 x1876716471494016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776464.278028:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471494016:0@lo:400:kworker.0 00000100:00100000:0.0:1789776464.278058:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3275:1876716471493760:0@lo:400:kworker.0 00010000:00080000:0.0:1789776464.278068:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bf7a9c00 x1876716471494272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776464.278075:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471494272:0@lo:400:kworker.0 00000100:00100000:0.0:1789776464.278085:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3275:1876716471494144:0@lo:400:kworker.0 00000100:00100000:1.0:1789776464.278244:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471493632 00000100:00100000:1.0:1789776464.278248:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471493632 00000100:00100000:1.0:1789776464.278285:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1789776464.278292:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+19:3275:x1876716471493632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776464.278333:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+19:3275:x1876716471493632:12345-0@lo:400:kworker.0 Request processed in 42us (1140us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776464.278339:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1789776464.278372:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa655c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471493632:0@lo:400:kworker.0 00010000:00010000:1.0:1789776464.788665:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776464.789561:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf29a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471494400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789776464.789634:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776464.790111:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471494400 00000100:00100000:1.0:1789776464.790119:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471494400 00000100:00100000:1.0:1789776464.790171:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789776464.790182:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9ded180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471494400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789776464.790243:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789776464.790305:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9ded180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471494400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776464.790313:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1789776464.790419:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bf29a680 x1876716471494400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776480 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776464.790450:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf29a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471494400:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789776465.189630:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776465.189684:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776465.189718:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462023296 00000100:00100000:3.0:1789776465.189728:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462023296 00000100:00100000:3.0:1789776465.189793:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 202 00000100:00100000:3.0:1789776465.189804:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:2354:x1876716462023296:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1789776465.189888:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:2354:x1876716462023296:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 86us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776465.189909:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 202 00000100:00100000:1.0:1789776465.191951:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462023424 00000100:00100000:1.0:1789776465.191966:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462023424 00000100:00100000:1.0:1789776465.192035:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 57 00000100:00100000:1.0:1789776465.192044:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+6:2354:x1876716462023424:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1789776465.192139:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+6:2354:x1876716462023424:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 95us (2523us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776465.192146:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 57 00000100:00080000:0.0:1789776465.193940:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789776465.813377:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776466.837230:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776467.860561:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776468.372518:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9dece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471494528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789776468.372611:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776468.373196:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471494528 00000100:00100000:1.0:1789776468.373207:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471494528 00000100:00100000:1.0:1789776468.373304:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789776468.373314:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471494528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789776468.373347:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789776468.373406:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471494528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776468.373414:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1789776468.373540:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86b9dece00 x1876716471494528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776484 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776468.373561:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9dece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471494528:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789776468.374075:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789776468.884565:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776469.397090:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471495040:0@lo:400:kworker.0 00000100:00100000:2.0:1789776469.397173:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776469.397203:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471494656:0@lo:400:kworker.0 00000100:00100000:2.0:1789776469.397271:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789776469.397278:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776469.397284:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9dece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3274:1876716471494912:0@lo:400:kworker.0 00000100:00100000:2.0:1789776469.397318:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776469.397325:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a01de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3275:1876716471495168:0@lo:400:kworker.0 00000100:00100000:1.0:1789776469.397359:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776469.397381:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789776469.397386:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3275:1876716471494784:0@lo:400:kworker.0 00000100:00100000:1.0:1789776469.397408:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776469.397428:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a01df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471495296:0@lo:400:kworker.0 00000100:00100000:2.0:1789776469.397452:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471494912 00000100:00100000:2.0:1789776469.397460:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471494912 00000100:00100000:1.0:1789776469.397467:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776469.397511:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471495168 00000100:00100000:2.0:1789776469.397516:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471495168 00000100:00100000:2.0:1789776469.397530:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471494784 00000100:00100000:2.0:1789776469.397532:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471494784 00000100:00100000:2.0:1789776469.397545:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789776469.397554:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1876716471494912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776469.397627:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1876716471494912:12345-0@lo:400:kworker.0 Request processed in 73us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776469.397634:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789776469.397657:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789776469.397665:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf299c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1876716471495168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776469.397680:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9dece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3274:1876716471494912:0@lo:400:kworker.0 00000100:00100000:2.0:1789776469.397706:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf299c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1876716471495168:12345-0@lo:400:kworker.0 Request processed in 42us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776469.397713:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789776469.397719:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a01de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3275:1876716471495168:0@lo:400:kworker.0 00000100:00100000:3.0:1789776469.397791:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471495040 00000100:00100000:3.0:1789776469.397797:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471495040 00000100:00100000:3.0:1789776469.397835:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471495296 00000100:00100000:3.0:1789776469.397838:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471495296 00000100:00100000:3.0:1789776469.397858:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789776469.397865:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471495040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776469.397906:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471495040:12345-0@lo:400:kworker.0 Request processed in 41us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776469.397913:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789776469.397927:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789776469.397933:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf29a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471495296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776469.397962:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf29a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471495296:12345-0@lo:400:kworker.0 Request processed in 30us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776469.397968:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789776469.397986:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789776469.397993:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf29bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1876716471494784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776469.398030:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf29bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1876716471494784:12345-0@lo:400:kworker.0 Request processed in 38us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776469.398087:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471494656 00000100:00100000:0.0:1789776469.398092:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471494656 00000100:00100000:0.0:1789776469.398122:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1789776469.398144:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+19:3275:x1876716471494656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776469.398150:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3275:1876716471494784:0@lo:400:kworker.0 00010000:00080000:1.0:1789776469.398166:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86a01df480 x1876716471495296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776469.398179:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a01df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471495296:0@lo:400:kworker.0 00000100:00100000:0.0:1789776469.398188:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+19:3275:x1876716471494656:12345-0@lo:400:kworker.0 Request processed in 57us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776469.398197:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1789776469.398204:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471494656:0@lo:400:kworker.0 00000100:00080000:1.0:1789776469.398273:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789776469.398278:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789776469.398322:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86b9deea00 x1876716471495040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776469.398333:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471495040:0@lo:400:kworker.0 00000100:00100000:3.0:1789776469.398410:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00010000:1.0:1789776469.908372:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776469.911118:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf299500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471495424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789776469.911186:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776469.911319:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471495424 00000100:00100000:2.0:1789776469.911343:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471495424 00000100:00100000:2.0:1789776469.911400:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789776469.911411:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471495424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789776469.911451:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789776469.914629:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471495424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3213us (3435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776469.914642:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1789776469.917885:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bf299500 x1876716471495424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776485 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776469.917916:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf299500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471495424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789776470.306612:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776470.306693:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462023552 00000100:00100000:3.0:1789776470.306703:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462023552 00000100:00100000:3.0:1789776470.306783:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 204 00000100:00100000:3.0:1789776470.306794:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:2357:x1876716462023552:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1789776470.306869:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:2357:x1876716462023552:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 78us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776470.306876:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 204 00000100:00100000:0.0:1789776470.313500:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776470.313785:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462023680 00000100:00100000:2.0:1789776470.313794:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462023680 00000100:00100000:2.0:1789776470.313874:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 61 00000100:00100000:2.0:1789776470.313884:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+6:2357:x1876716462023680:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1789776470.313965:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+6:2357:x1876716462023680:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 83us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776470.313974:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 61 00000100:00080000:1.0:1789776470.314235:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789776470.948023:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789776471.278107:0:10090:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 20:07:50 (1789776470) === 00000100:00100000:1.0:1789776471.738288:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776471.738534:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462023808 00000100:00100000:3.0:1789776471.738550:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462023808 00000100:00100000:3.0:1789776471.738626:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 205 00000100:00100000:3.0:1789776471.738640:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:8121:x1876716462023808:12345-192.168.202.6@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789776471.738673:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776471.738699:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c8681678600/0x26940258de8ef13e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2636 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776471.738748:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c8681678600/0x26940258de8ef13e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2636 expref: 11 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776471.738762:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c8681678600/0x26940258de8ef13e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2636 expref: 11 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776471.738774:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8681678600, rc 0) 00000100:00100000:3.0:1789776471.738849:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+11:8121:x1876716462023808:12345-192.168.202.6@tcp:101:mount.lustre.0 Request processed in 212us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776471.738857:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 205 00000100:00100000:3.0:1789776471.751780:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776471.752020:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462023936 00000100:00100000:0.0:1789776471.752036:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462023936 00000100:00100000:0.0:1789776471.752114:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 206 00000100:00100000:0.0:1789776471.752127:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+11:8121:x1876716462023936:12345-192.168.202.6@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789776471.754605:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+11:8121:x1876716462023936:12345-192.168.202.6@tcp:501:mount.lustre.0 Request processed in 2465us (2827us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776471.754625:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 206 00000100:00100000:0.0:1789776471.768912:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776471.769872:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462024064 00000100:00100000:1.0:1789776471.769889:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462024064 00000100:00100000:1.0:1789776471.769977:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 207 00000100:00100000:1.0:1789776471.769990:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+11:8121:x1876716462024064:12345-192.168.202.6@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789776471.770425:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+11:8121:x1876716462024064:12345-192.168.202.6@tcp:503:mount.lustre.0 Request processed in 435us (1528us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776471.770434:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 207 00000100:00100000:1.0:1789776471.777282:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776471.777417:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462024192 00000100:00100000:0.0:1789776471.777431:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462024192 00000100:00100000:0.0:1789776471.777510:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 208 00000100:00100000:0.0:1789776471.777523:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+11:8125:x1876716462024192:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789776471.777952:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+11:8125:x1876716462024192:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 429us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776471.777961:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 208 00000100:00100000:3.0:1789776471.805990:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776471.806627:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462024320 00000100:00100000:1.0:1789776471.806644:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462024320 00000100:00100000:1.0:1789776471.806900:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 209 00000100:00100000:1.0:1789776471.806914:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+11:8125:x1876716462024320:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789776471.807798:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+11:8125:x1876716462024320:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 883us (1830us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776471.807809:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 209 00000100:00100000:2.0:1789776471.814539:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776471.814686:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462024448 00000100:00100000:0.0:1789776471.814700:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462024448 00000100:00100000:0.0:1789776471.814780:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 210 00000100:00100000:0.0:1789776471.814793:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+11:8121:x1876716462024448:12345-192.168.202.6@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789776471.814818:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776471.814842:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c8680031c00/0x26940258de8ef145 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2660 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776471.814909:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c8680031c00/0x26940258de8ef145 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2660 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776471.814922:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c8680031c00/0x26940258de8ef145 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2660 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776471.814933:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8680031c00, rc 0) 00000100:00100000:0.0:1789776471.815870:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+12:8121:x1876716462024448:12345-192.168.202.6@tcp:101:mount.lustre.0 Request processed in 1070us (1338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776471.815882:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 210 00000100:00100000:2.0:1789776471.825408:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776471.825574:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462024576 00000100:00100000:1.0:1789776471.825589:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462024576 00000100:00100000:1.0:1789776471.825673:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 211 00000100:00100000:1.0:1789776471.825687:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+12:8121:x1876716462024576:12345-192.168.202.6@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789776471.825734:0:5805:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789776471.825766:0:5805:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789776471.825771:0:5805:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789776471.825774:0:5805:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789776471.825777:0:5805:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1789776471.836447:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+12:8121:x1876716462024576:12345-192.168.202.6@tcp:256:mount.lustre.0 Request processed in 10742us (11034us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776471.836471:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 211 00000100:00100000:2.0:1789776471.842567:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776471.842844:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462024704 00000100:00100000:0.0:1789776471.842859:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462024704 00000100:00100000:0.0:1789776471.842941:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 212 00000100:00100000:0.0:1789776471.842953:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+12:8121:x1876716462024704:12345-192.168.202.6@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789776471.842975:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776471.842999:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c8680031400/0x26940258de8ef14c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2667 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776471.843037:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c8680031400/0x26940258de8ef14c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2667 expref: 13 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776471.843051:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c8680031400/0x26940258de8ef14c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2667 expref: 13 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776471.843062:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8680031400, rc 0) 00000100:00100000:0.0:1789776471.843142:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:8121:x1876716462024704:12345-192.168.202.6@tcp:101:mount.lustre.0 Request processed in 190us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776471.843172:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 212 00000100:00100000:2.0:1789776471.846614:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776471.847329:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462024832 00000100:00100000:3.0:1789776471.847346:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462024832 00000100:00100000:3.0:1789776471.847498:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 213 00000100:00100000:3.0:1789776471.847510:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:8121:x1876716462024832:12345-192.168.202.6@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789776471.847919:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:8121:x1876716462024832:12345-192.168.202.6@tcp:501:mount.lustre.0 Request processed in 410us (1320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776471.847928:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 213 00000100:00100000:1.0:1789776471.852291:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776471.852501:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462024960 00000100:00100000:3.0:1789776471.852516:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462024960 00000100:00100000:2.0:1789776471.854719:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 214 00000100:00100000:2.0:1789776471.854761:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:8121:x1876716462024960:12345-192.168.202.6@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789776471.855412:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:8121:x1876716462024960:12345-192.168.202.6@tcp:503:mount.lustre.0 Request processed in 662us (3134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776471.855424:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 214 00000100:00100000:2.0:1789776471.860568:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776471.860758:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462025088 00000100:00100000:0.0:1789776471.860779:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462025088 00000100:00100000:0.0:1789776471.860855:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 215 00000100:00100000:0.0:1789776471.860868:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:8129:x1876716462025088:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789776471.861244:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:8129:x1876716462025088:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 352us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776471.861254:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 215 00000100:00100000:1.0:1789776471.866848:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776471.867713:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462025216 00000100:00100000:2.0:1789776471.867740:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462025216 00000100:00100000:2.0:1789776471.868350:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 216 00000100:00100000:2.0:1789776471.868366:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:8129:x1876716462025216:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789776471.868760:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:8129:x1876716462025216:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 398us (1926us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776471.868769:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 216 00000100:00100000:3.0:1789776471.875910:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776471.875958:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776471.876522:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462025344 00000100:00100000:1.0:1789776471.876540:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462025344 00000100:00100000:1.0:1789776471.876609:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462025728 00000100:00100000:1.0:1789776471.876614:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462025728 00000100:00100000:1.0:1789776471.876769:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 62 00000100:00100000:1.0:1789776471.876783:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af8c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+6:2355:x1876716462025728:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1789776471.876789:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00100000:3.0:1789776471.876796:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af8c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2353:x1876716462025344:12345-192.168.202.6@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789776471.876834:0:8177:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from d27fff26-e747-430b-8151-cc0e7e6df617@192.168.202.6@tcp t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:3.0:1789776471.876898:0:8177:0:(genops.c:1385:class_connect()) connect: client d27fff26-e747-430b-8151-cc0e7e6df617, cookie 0x26940258de8ef153 00000004:00100000:3.0:1789776471.876943:0:8177:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1789776471.876955:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af8c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+6:2355:x1876716462025728:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 175us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776471.876964:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 62 00000100:00080000:1.0:1789776471.878515:0:8177:0:(import.c:65:import_set_state_nolock()) ffff9c86bf5f5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789776471.878597:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af8c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d27fff26-e747-430b-8151-cc0e7e6df617+6:2353:x1876716462025344:12345-192.168.202.6@tcp:38:mount.lustre.0 Request processed in 1789us (2694us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776471.878609:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00100000:3.0:1789776471.886920:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776471.887051:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776471.887805:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462025600 00000100:00100000:1.0:1789776471.887823:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462025600 00000100:00100000:1.0:1789776471.887925:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462025472 00000100:00100000:1.0:1789776471.887929:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462025472 00000100:00100000:1.0:1789776471.887987:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 11 00000100:00100000:1.0:1789776471.888000:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d27fff26-e747-430b-8151-cc0e7e6df617+7:8121:x1876716462025600:12345-192.168.202.6@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789776471.888070:0:5811:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789776471.888250:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d27fff26-e747-430b-8151-cc0e7e6df617+7:8121:x1876716462025600:12345-192.168.202.6@tcp:41:mount.lustre.0 Request processed in 252us (1346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776471.888259:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 11 00000100:00100000:1.0:1789776471.888281:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 12 00000100:00100000:1.0:1789776471.888288:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af8c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d27fff26-e747-430b-8151-cc0e7e6df617+6:0:x1876716462025472:12345-192.168.202.6@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789776471.888301:0:5811:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789776471.888327:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af8c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d27fff26-e747-430b-8151-cc0e7e6df617+6:0:x1876716462025472:12345-192.168.202.6@tcp:41:mount.lustre.0 Request processed in 39us (1274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776471.888333:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 12 00000100:00080000:0.0:1789776471.889001:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789776471.892933:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776471.893034:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462025856 00000100:00100000:1.0:1789776471.893047:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462025856 00000100:00100000:1.0:1789776471.893141:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 13 00000100:00100000:1.0:1789776471.893154:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d27fff26-e747-430b-8151-cc0e7e6df617+6:8121:x1876716462025856:12345-192.168.202.6@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789776471.893321:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d27fff26-e747-430b-8151-cc0e7e6df617+6:8121:x1876716462025856:12345-192.168.202.6@tcp:40:mount.lustre.0 Request processed in 169us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776471.893329:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 13 00000100:00100000:1.0:1789776471.896049:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776471.896112:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776471.896279:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776471.896339:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462026240 00000100:00100000:2.0:1789776471.896354:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462026240 00000100:00100000:2.0:1789776471.896428:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1 00000100:00100000:2.0:1789776471.896441:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9defb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d27fff26-e747-430b-8151-cc0e7e6df617+6:8121:x1876716462026240:12345-192.168.202.6@tcp:33:mount.lustre.0 00000004:00200000:2.0:1789776471.896548:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789776471.896671:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9defb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d27fff26-e747-430b-8151-cc0e7e6df617+6:8121:x1876716462026240:12345-192.168.202.6@tcp:33:mount.lustre.0 Request processed in 232us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776471.896679:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1 00000100:00100000:0.0:1789776471.896939:0:8384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462025984 00000100:00100000:0.0:1789776471.896946:0:8384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462025984 00000100:00100000:0.0:1789776471.897823:0:8384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462026112 00000100:00100000:0.0:1789776471.897833:0:8384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462026112 00000100:00100000:0.0:1789776471.897870:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 12 00000100:00100000:0.0:1789776471.897878:0:8384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf299500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2353:x1876716462025984:12345-192.168.202.6@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789776471.897911:0:8384:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from d27fff26-e747-430b-8151-cc0e7e6df617@192.168.202.6@tcp t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:0.0:1789776471.897956:0:8384:0:(genops.c:1385:class_connect()) connect: client d27fff26-e747-430b-8151-cc0e7e6df617, cookie 0x26940258de8ef15a 00002000:00100000:0.0:1789776471.898207:0:8384:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d27fff26-e747-430b-8151-cc0e7e6df617/ffff9c86ba89f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789776471.898261:0:8384:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1789776471.899084:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 13 00000100:00100000:2.0:1789776471.899154:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9deea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1876716462026112:12345-192.168.202.6@tcp:8:mount.lustre.0 00002000:00080000:0.0:1789776471.899397:0:8384:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789776471.899447:0:8384:0:(import.c:65:import_set_state_nolock()) ffff9c86ba89f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789776471.899543:0:8384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf299500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d27fff26-e747-430b-8151-cc0e7e6df617+6:2353:x1876716462025984:12345-192.168.202.6@tcp:8:mount.lustre.0 Request processed in 1664us (3510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776471.899553:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 12 00010000:00080000:2.0:1789776471.899564:0:6659:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from d27fff26-e747-430b-8151-cc0e7e6df617@192.168.202.6@tcp t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:2.0:1789776471.899611:0:6659:0:(genops.c:1385:class_connect()) connect: client d27fff26-e747-430b-8151-cc0e7e6df617, cookie 0x26940258de8ef161 00002000:00100000:2.0:1789776471.900152:0:6659:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d27fff26-e747-430b-8151-cc0e7e6df617/ffff9c86bc8e2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789776471.900176:0:6659:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789776471.900536:0:6659:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789776471.900559:0:6659:0:(import.c:65:import_set_state_nolock()) ffff9c86bc8e0000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789776471.900761:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9deea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d27fff26-e747-430b-8151-cc0e7e6df617+6:2353:x1876716462026112:12345-192.168.202.6@tcp:8:mount.lustre.0 Request processed in 1467us (4506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776471.900771:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 13 00010000:00010000:0.0:1789776471.957207:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776472.990680:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776473.492575:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb4f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471495552:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789776473.492676:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776473.492826:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471495552 00000100:00100000:0.0:1789776473.492836:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471495552 00000100:00100000:0.0:1789776473.492910:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789776473.492920:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471495552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789776473.492984:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789776473.493035:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471495552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776473.493042:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1789776473.493067:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789776473.493109:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bb4f2a00 x1876716471495552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776489 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776473.493131:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb4f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471495552:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789776474.004432:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789776474.089684:0:7615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d27fff26-e747-430b-8151-cc0e7e6df617 00000001:00100000:2.0:1789776474.090949:0:5833:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d27fff26-e747-430b-8151-cc0e7e6df617 00000100:00100000:2.0:1789776474.517499:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a01df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3273:1876716471495936:0@lo:400:kworker.0 00000100:00100000:2.0:1789776474.517600:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776474.517676:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789776474.517683:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a01de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471496064:0@lo:400:kworker.0 00000100:00100000:2.0:1789776474.517724:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776474.517772:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471495936 00000100:00100000:2.0:1789776474.517782:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471495936 00000100:00100000:2.0:1789776474.517861:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789776474.517873:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf34f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1876716471495936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776474.517935:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf34f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1876716471495936:12345-0@lo:400:kworker.0 Request processed in 64us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776474.517943:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1789776474.517969:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789776474.518010:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a01df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3273:1876716471495936:0@lo:400:kworker.0 00000100:00100000:0.0:1789776474.518535:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a01dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876716471495808:0@lo:400:kworker.0 00000100:00100000:0.0:1789776474.518581:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776474.518612:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf34d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471496320:0@lo:400:kworker.0 00000100:00100000:0.0:1789776474.518637:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776474.518661:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789776474.518667:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a01dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9db43398-240e-4f78-8778-c11d527e09a1:3276:1876716471495680:0@lo:400:kworker.0 00000100:00100000:0.0:1789776474.518699:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776474.518739:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf34e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3276:1876716471496192:0@lo:400:kworker.0 00000100:00100000:0.0:1789776474.518768:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776474.518802:0:8384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471496064 00000100:00100000:0.0:1789776474.518808:0:8384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471496064 00000100:00100000:0.0:1789776474.518858:0:8384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471496320 00000100:00100000:0.0:1789776474.518861:0:8384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471496320 00000100:00100000:0.0:1789776474.518894:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789776474.518901:0:8384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf34ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471496064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776474.518943:0:8384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf34ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471496064:12345-0@lo:400:kworker.0 Request processed in 43us (1218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776474.518950:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789776474.518964:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789776474.518970:0:8384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471496320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776474.519005:0:8384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471496320:12345-0@lo:400:kworker.0 Request processed in 35us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776474.519012:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789776474.519033:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471495808 00000100:00100000:0.0:1789776474.519037:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471495808 00000100:00100000:0.0:1789776474.519058:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471496192 00000100:00100000:0.0:1789776474.519060:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471496192 00000100:00100000:0.0:1789776474.519081:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789776474.519087:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876716471495808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776474.519119:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876716471495808:12345-0@lo:400:kworker.0 Request processed in 33us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776474.519125:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789776474.519137:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789776474.519143:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876716471496192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776474.519169:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876716471496192:12345-0@lo:400:kworker.0 Request processed in 27us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776474.519176:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789776474.519199:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471495680 00000100:00100000:0.0:1789776474.519211:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471495680 00000100:00100000:0.0:1789776474.519270:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1789776474.519276:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+19:3276:x1876716471495680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776474.519309:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+19:3276:x1876716471495680:12345-0@lo:400:kworker.0 Request processed in 33us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776474.519314:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00080000:0.0:1789776474.519364:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789776474.519369:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789776474.519392:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a01dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9db43398-240e-4f78-8778-c11d527e09a1:3276:1876716471495680:0@lo:400:kworker.0 00000100:00100000:0.0:1789776474.519405:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf34e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3276:1876716471496192:0@lo:400:kworker.0 00000100:00100000:0.0:1789776474.519414:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a01dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876716471495808:0@lo:400:kworker.0 00010000:00080000:0.0:1789776474.519427:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bf34d880 x1876716471496320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776474.519439:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf34d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471496320:0@lo:400:kworker.0 00010000:00080000:2.0:1789776474.519545:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86a01de300 x1876716471496064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776474.519555:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a01de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471496064:0@lo:400:kworker.0 00000001:00100000:2.0:1789776474.591878:0:6684:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d27fff26-e747-430b-8151-cc0e7e6df617 00010000:00010000:2.0:1789776475.029055:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776475.029339:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471496448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789776475.029433:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776475.029598:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471496448 00000100:00100000:1.0:1789776475.029623:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471496448 00000100:00100000:1.0:1789776475.029688:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789776475.029710:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf34df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471496448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789776475.029878:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789776475.029951:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf34df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471496448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 252us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776475.029959:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1789776475.030045:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86b9deca80 x1876716471496448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776491 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776475.030083:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471496448:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789776476.052609:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776476.962098:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776476.962163:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776476.962202:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776476.962299:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776476.962583:0:8384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462026880 00000100:00100000:3.0:1789776476.962597:0:8384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462026880 00000100:00100000:3.0:1789776476.962708:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 37 00000100:00100000:3.0:1789776476.962722:0:8384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf34c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d27fff26-e747-430b-8151-cc0e7e6df617+5:2354:x1876716462026880:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1789776476.962831:0:8384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf34c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d27fff26-e747-430b-8151-cc0e7e6df617+5:2354:x1876716462026880:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 113us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776476.962841:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 37 00000100:00100000:2.0:1789776476.962988:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776476.963613:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462026368 00000100:00100000:1.0:1789776476.963621:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462026368 00000100:00100000:1.0:1789776476.963669:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 218 00000100:00100000:1.0:1789776476.963677:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:2354:x1876716462026368:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1789776476.963732:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:2354:x1876716462026368:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 56us (1652us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776476.963739:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 218 00000100:00100000:0.0:1789776476.964308:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462026624 00000100:00100000:0.0:1789776476.964315:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462026624 00000100:00100000:0.0:1789776476.964380:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462026496 00000100:00100000:0.0:1789776476.964384:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462026496 00000100:00100000:0.0:1789776476.964412:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 66 00000100:00100000:0.0:1789776476.964427:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf34f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d27fff26-e747-430b-8151-cc0e7e6df617+5:2354:x1876716462026624:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1789776476.964482:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf34f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d27fff26-e747-430b-8151-cc0e7e6df617+5:2354:x1876716462026624:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 57us (2317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776476.964489:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 66 00000100:00100000:0.0:1789776476.964505:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 67 00000100:00100000:0.0:1789776476.964529:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf34ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+6:2354:x1876716462026496:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1789776476.964558:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf34ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+6:2354:x1876716462026496:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 31us (2259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776476.964565:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 67 00000100:00080000:0.0:1789776476.964602:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789776476.964609:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789776476.964623:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462026752 00000100:00100000:0.0:1789776476.964627:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462026752 00000100:00100000:0.0:1789776476.964664:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 38 00000100:00100000:0.0:1789776476.964671:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf34c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d27fff26-e747-430b-8151-cc0e7e6df617+5:2354:x1876716462026752:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1789776476.964711:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf34c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d27fff26-e747-430b-8151-cc0e7e6df617+5:2354:x1876716462026752:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 41us (1724us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776476.964718:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 38 00000100:00080000:1.0:1789776476.964861:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789776477.077174:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776478.101104:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789776478.386097:0:10289:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:0.0:1789776478.615706:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb4f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471496576:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789776478.615819:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776478.615930:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471496576 00000100:00100000:3.0:1789776478.615942:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471496576 00000100:00100000:3.0:1789776478.616013:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789776478.616026:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471496576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789776478.616074:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789776478.616141:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471496576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776478.616149:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1789776478.616175:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789776478.617622:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bb4f3100 x1876716471496576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776494 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776478.617656:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb4f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471496576:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789776479.125293:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776479.643061:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876716471496832:0@lo:400:kworker.0 00000100:00100000:1.0:1789776479.643161:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776479.643255:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bff63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471497344:0@lo:400:kworker.0 00000100:00100000:1.0:1789776479.643284:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776479.643318:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789776479.643323:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9dece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9db43398-240e-4f78-8778-c11d527e09a1:3276:1876716471496704:0@lo:400:kworker.0 00000100:00100000:1.0:1789776479.643354:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776479.643376:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bff61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3276:1876716471497216:0@lo:400:kworker.0 00000100:00100000:3.0:1789776479.644196:0:8384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471497344 00000100:00100000:3.0:1789776479.644209:0:8384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471497344 00000100:00100000:3.0:1789776479.644308:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789776479.644320:0:8384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bff62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471497344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776479.644414:0:8384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bff62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471497344:12345-0@lo:400:kworker.0 Request processed in 96us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776479.644421:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1789776479.644446:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789776479.645364:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789776479.646261:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bff63480 x1876716471497344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776479.646290:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bff63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471497344:0@lo:400:kworker.0 00000100:00100000:1.0:1789776479.646331:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bff60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3273:1876716471496960:0@lo:400:kworker.0 00000100:00100000:1.0:1789776479.646396:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776479.656108:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789776479.656135:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bff60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471497088:0@lo:400:kworker.0 00000100:00100000:1.0:1789776479.656244:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776479.656328:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471497088 00000100:00100000:3.0:1789776479.656338:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471497088 00000100:00100000:3.0:1789776479.656408:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789776479.656419:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bff63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471497088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776479.656496:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bff63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471497088:12345-0@lo:400:kworker.0 Request processed in 78us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776479.656521:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789776479.656817:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471496832 00000100:00100000:2.0:1789776479.656823:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471496832 00000100:00100000:2.0:1789776479.656971:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471497216 00000100:00100000:2.0:1789776479.656976:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471497216 00000100:00100000:3.0:1789776479.656984:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471496960 00000100:00100000:3.0:1789776479.656989:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471496960 00000100:00080000:2.0:1789776479.656999:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789776479.657009:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789776479.657016:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bff60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876716471496832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776479.657017:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789776479.657023:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bff63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1876716471496960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776479.657061:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bff63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1876716471496960:12345-0@lo:400:kworker.0 Request processed in 39us (10678us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776479.657065:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bff60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876716471496832:12345-0@lo:400:kworker.0 Request processed in 50us (13906us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776479.657068:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789776479.657072:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789776479.657081:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789776479.657087:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bff61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876716471497216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776479.657115:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bff61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876716471497216:12345-0@lo:400:kworker.0 Request processed in 29us (11755us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776479.657122:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789776479.658296:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471496704 00000100:00100000:0.0:1789776479.658308:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471496704 00000100:00100000:0.0:1789776479.658362:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1789776479.658372:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa595450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+19:3276:x1876716471496704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776479.658445:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa595450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+19:3276:x1876716471496704:12345-0@lo:400:kworker.0 Request processed in 75us (15089us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776479.658459:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00010000:00080000:3.0:1789776479.661451:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bff60e00 x1876716471497088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776479.661476:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bff60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471497088:0@lo:400:kworker.0 00000100:00100000:3.0:1789776479.661495:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bff60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3273:1876716471496960:0@lo:400:kworker.0 00000100:00100000:0.0:1789776479.661695:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9dece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9db43398-240e-4f78-8778-c11d527e09a1:3276:1876716471496704:0@lo:400:kworker.0 00000100:00100000:0.0:1789776479.661713:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bff61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3276:1876716471497216:0@lo:400:kworker.0 00000100:00100000:0.0:1789776479.661728:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876716471496832:0@lo:400:kworker.0 00010000:00010000:2.0:1789776480.150034:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776480.150272:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471497472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789776480.150368:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776480.150567:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471497472 00000100:00100000:0.0:1789776480.150577:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471497472 00000100:00100000:0.0:1789776480.150664:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789776480.150678:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf34d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471497472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789776480.150736:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789776480.150805:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf34d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471497472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776480.150814:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1789776480.151251:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bf7aa300 x1876716471497472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776496 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776480.151283:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471497472:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789776481.172474:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776482.082304:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776482.082348:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776482.082391:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776482.082425:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776482.082461:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776482.082590:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462027008 00000100:00100000:1.0:1789776482.082605:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462027008 00000100:00100000:1.0:1789776482.082682:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 220 00000100:00100000:1.0:1789776482.082696:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:2355:x1876716462027008:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1789776482.082792:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:2355:x1876716462027008:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 100us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776482.082801:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 220 00000100:00100000:2.0:1789776482.084181:0:8384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462027520 00000100:00100000:2.0:1789776482.084239:0:8384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462027520 00000100:00100000:2.0:1789776482.084326:0:8384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462027392 00000100:00100000:2.0:1789776482.084330:0:8384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462027392 00000100:00100000:2.0:1789776482.084357:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 41 00000100:00100000:2.0:1789776482.084379:0:8384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d27fff26-e747-430b-8151-cc0e7e6df617+5:2355:x1876716462027520:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1789776482.084462:0:8384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d27fff26-e747-430b-8151-cc0e7e6df617+5:2355:x1876716462027520:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 85us (2070us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776482.084470:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 41 00000100:00100000:2.0:1789776482.084488:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 42 00000100:00100000:2.0:1789776482.084495:0:8384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba7d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d27fff26-e747-430b-8151-cc0e7e6df617+5:2355:x1876716462027392:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1789776482.084518:0:8384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba7d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d27fff26-e747-430b-8151-cc0e7e6df617+5:2355:x1876716462027392:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 24us (2057us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776482.084524:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 42 00000100:00100000:2.0:1789776482.084748:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462027264 00000100:00100000:2.0:1789776482.084753:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462027264 00000100:00100000:2.0:1789776482.084782:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462027136 00000100:00100000:2.0:1789776482.084786:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462027136 00000100:00100000:2.0:1789776482.084805:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 71 00000100:00100000:2.0:1789776482.084811:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d27fff26-e747-430b-8151-cc0e7e6df617+5:2355:x1876716462027264:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1789776482.084842:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d27fff26-e747-430b-8151-cc0e7e6df617+5:2355:x1876716462027264:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 31us (2494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776482.084849:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 71 00000100:00100000:2.0:1789776482.084883:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 72 00000100:00100000:2.0:1789776482.084889:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+6:2355:x1876716462027136:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1789776482.084919:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+6:2355:x1876716462027136:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 30us (2494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776482.084925:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 72 00000100:00080000:1.0:1789776482.085574:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789776482.085582:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789776482.085586:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789776482.210230:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776483.220510:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776483.738701:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789776483.747563:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb4f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471497600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789776483.747652:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776483.747823:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471497600 00000100:00100000:3.0:1789776483.747833:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471497600 00000100:00100000:3.0:1789776483.747904:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789776483.747915:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf34ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471497600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789776483.747953:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789776483.748008:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf34ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471497600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776483.748015:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1789776483.748060:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bb4f3b80 x1876716471497600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776499 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776483.748078:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb4f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471497600:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789776483.748190:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789776484.244472:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776484.756758:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3273:1876716471497984:0@lo:400:kworker.0 00000100:00100000:2.0:1789776484.756852:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776484.756927:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789776484.756933:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471498112:0@lo:400:kworker.0 00000100:00100000:2.0:1789776484.756972:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776484.757010:0:8384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471498112 00000100:00100000:2.0:1789776484.757016:0:8384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471498112 00000100:00100000:0.0:1789776484.757213:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471497984 00000100:00100000:0.0:1789776484.757236:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471497984 00000100:00100000:0.0:1789776484.757279:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789776484.757289:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf34c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1876716471497984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776484.757347:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf34c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1876716471497984:12345-0@lo:400:kworker.0 Request processed in 60us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776484.757355:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1789776484.757375:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789776484.757425:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3273:1876716471497984:0@lo:400:kworker.0 00000100:00100000:2.0:1789776484.757692:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471497728:0@lo:400:kworker.0 00000100:00100000:2.0:1789776484.757735:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776484.757747:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789776484.757775:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf34c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471498112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776484.757787:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3275:1876716471498240:0@lo:400:kworker.0 00000100:00100000:2.0:1789776484.757824:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776484.757871:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789776484.757881:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3275:1876716471497856:0@lo:400:kworker.0 00000100:00100000:3.0:1789776484.757889:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf34c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471498112:12345-0@lo:400:kworker.0 Request processed in 127us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776484.757899:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789776484.757920:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776484.757971:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471497728 00000100:00100000:3.0:1789776484.757980:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471497728 00000100:00100000:3.0:1789776484.758018:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1789776484.758025:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa597050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+19:3275:x1876716471497728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776484.758063:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa597050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+19:3275:x1876716471497728:12345-0@lo:400:kworker.0 Request processed in 38us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776484.758070:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1789776484.758118:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471498240 00000100:00100000:3.0:1789776484.758122:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471498240 00000100:00100000:2.0:1789776484.758150:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471498368:0@lo:400:kworker.0 00000100:00100000:3.0:1789776484.758158:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471497856 00000100:00100000:3.0:1789776484.758162:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471497856 00000100:00100000:3.0:1789776484.758185:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789776484.758194:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf34e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1876716471498240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776484.758213:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776484.758293:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471497728:0@lo:400:kworker.0 00000100:00100000:2.0:1789776484.758306:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3275:1876716471498240:0@lo:400:kworker.0 00000100:00100000:0.0:1789776484.758343:0:8384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471498368 00000100:00100000:0.0:1789776484.758350:0:8384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471498368 00000100:00080000:2.0:1789776484.758384:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789776484.758391:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789776484.758402:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789776484.758415:0:8384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf34fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471498368:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1789776484.758426:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bf7aad80 x1876716471498112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776484.758441:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471498112:0@lo:400:kworker.0 00000100:00100000:1.0:1789776484.758514:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789776484.758527:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf34dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1876716471497856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776484.758585:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf34e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1876716471498240:12345-0@lo:400:kworker.0 Request processed in 390us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776484.758598:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789776484.768701:0:8384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf34fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471498368:12345-0@lo:400:kworker.0 Request processed in 10274us (10476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776484.768723:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1789776484.768824:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bf7abb80 x1876716471498368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776484.768843:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471498368:0@lo:400:kworker.0 00000100:00100000:1.0:1789776484.769759:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf34dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1876716471497856:12345-0@lo:400:kworker.0 Request processed in 11224us (11829us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776484.769817:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3275:1876716471497856:0@lo:400:kworker.0 00000100:00100000:1.0:1789776484.770747:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:3.0:1789776485.269695:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776485.270776:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bff62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471498496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789776485.270882:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776485.274469:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471498496 00000100:00100000:3.0:1789776485.274492:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471498496 00000100:00100000:3.0:1789776485.275188:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789776485.275206:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf34c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471498496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789776485.275434:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789776485.275558:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf34c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471498496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 358us (4676us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776485.275645:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1789776485.275833:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bff62a00 x1876716471498496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776501 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776485.275859:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bff62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471498496:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789776486.299092:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776487.206015:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776487.206062:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776487.206099:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776487.206123:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776487.206147:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776487.206188:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462028032 00000100:00100000:0.0:1789776487.206199:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462028032 00000100:00100000:0.0:1789776487.206274:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462028160 00000100:00100000:0.0:1789776487.206277:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462028160 00000100:00100000:0.0:1789776487.206300:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 45 00000100:00100000:0.0:1789776487.206309:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d27fff26-e747-430b-8151-cc0e7e6df617+5:2355:x1876716462028032:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1789776487.206384:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d27fff26-e747-430b-8151-cc0e7e6df617+5:2355:x1876716462028032:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 77us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776487.206409:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 45 00000100:00100000:2.0:1789776487.207586:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462027776 00000100:00100000:2.0:1789776487.207596:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462027776 00000100:00100000:2.0:1789776487.207655:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462027904 00000100:00100000:2.0:1789776487.207659:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462027904 00000100:00100000:2.0:1789776487.207689:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 76 00000100:00100000:2.0:1789776487.207699:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+6:2355:x1876716462027776:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1789776487.207750:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+6:2355:x1876716462027776:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 53us (1755us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776487.207758:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 76 00000100:00100000:2.0:1789776487.207775:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 77 00000100:00100000:2.0:1789776487.207781:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d27fff26-e747-430b-8151-cc0e7e6df617+5:2355:x1876716462027904:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1789776487.207820:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d27fff26-e747-430b-8151-cc0e7e6df617+5:2355:x1876716462027904:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 39us (1696us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776487.207827:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 77 00000100:00100000:2.0:1789776487.207855:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 46 00000100:00100000:2.0:1789776487.207863:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d27fff26-e747-430b-8151-cc0e7e6df617+5:2355:x1876716462028160:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1789776487.207889:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d27fff26-e747-430b-8151-cc0e7e6df617+5:2355:x1876716462028160:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 28us (1740us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776487.207895:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 46 00000100:00080000:2.0:1789776487.207914:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789776487.207918:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789776487.207921:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789776487.208096:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462027648 00000100:00100000:2.0:1789776487.208101:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462027648 00000100:00100000:2.0:1789776487.208131:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 222 00000100:00100000:2.0:1789776487.208139:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa594450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:2355:x1876716462027648:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1789776487.208170:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa594450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:2355:x1876716462027648:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 33us (2071us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776487.208176:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 222 00010000:00010000:0.0:1789776487.316408:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776488.345799:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776488.853794:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb4f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471498624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789776488.853895:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776488.854309:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471498624 00000100:00100000:3.0:1789776488.854321:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471498624 00000100:00100000:3.0:1789776488.854400:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789776488.854412:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bff61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471498624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789776488.854464:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789776488.854531:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bff61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471498624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776488.854539:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1789776488.854565:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789776488.861012:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bb4f3b80 x1876716471498624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776504 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776488.861050:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb4f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471498624:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789776489.369834:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776489.880715:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bff63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471498752:0@lo:400:kworker.0 00000100:00100000:0.0:1789776489.880904:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776489.881029:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789776489.881036:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bff60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3275:1876716471498880:0@lo:400:kworker.0 00000100:00100000:0.0:1789776489.881073:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776489.881121:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471498752 00000100:00100000:0.0:1789776489.881131:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471498752 00000100:00100000:0.0:1789776489.881191:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789776489.881201:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa596c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+19:3275:x1876716471498752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776489.881305:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa596c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+19:3275:x1876716471498752:12345-0@lo:400:kworker.0 Request processed in 105us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776489.881313:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789776489.881353:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471498880 00000100:00100000:0.0:1789776489.881356:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471498880 00000100:00100000:0.0:1789776489.881384:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789776489.881390:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1876716471498880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776489.881426:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1876716471498880:12345-0@lo:400:kworker.0 Request processed in 36us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776489.881431:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789776489.881483:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bff60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3275:1876716471498880:0@lo:400:kworker.0 00000100:00100000:0.0:1789776489.881495:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bff63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471498752:0@lo:400:kworker.0 00000100:00100000:1.0:1789776489.882447:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bff62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3273:1876716471499008:0@lo:400:kworker.0 00000100:00100000:1.0:1789776489.882508:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776489.882542:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789776489.882547:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bff60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471499136:0@lo:400:kworker.0 00000100:00100000:1.0:1789776489.882571:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776489.882619:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471499008 00000100:00100000:1.0:1789776489.882625:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471499008 00000100:00100000:1.0:1789776489.882683:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789776489.882694:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bff61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1876716471499008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776489.882744:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bff61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1876716471499008:12345-0@lo:400:kworker.0 Request processed in 53us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776489.882750:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789776489.882900:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471499136 00000100:00100000:1.0:1789776489.882905:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471499136 00000100:00100000:1.0:1789776489.882937:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789776489.882945:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bff63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471499136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776489.882984:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bff63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471499136:12345-0@lo:400:kworker.0 Request processed in 39us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776489.882990:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1789776489.883009:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789776489.883043:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bff60380 x1876716471499136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776489.883058:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bff60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471499136:0@lo:400:kworker.0 00000100:00100000:1.0:1789776489.883071:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bff62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3273:1876716471499008:0@lo:400:kworker.0 00000100:00100000:0.0:1789776489.883346:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bff61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3275:1876716471499264:0@lo:400:kworker.0 00000100:00100000:0.0:1789776489.883401:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776489.883425:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789776489.883431:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bff62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471499392:0@lo:400:kworker.0 00000100:00100000:0.0:1789776489.883455:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776489.883496:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471499392 00000100:00100000:0.0:1789776489.883501:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471499392 00000100:00100000:0.0:1789776489.883539:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789776489.883544:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471499392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776489.883594:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471499392:12345-0@lo:400:kworker.0 Request processed in 49us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776489.883600:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1789776489.883630:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bff62680 x1876716471499392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776489.883640:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bff62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471499392:0@lo:400:kworker.0 00000100:00080000:0.0:1789776489.883657:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789776489.884044:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471499264 00000100:00100000:1.0:1789776489.884050:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471499264 00000100:00100000:1.0:1789776489.884111:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789776489.884118:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1876716471499264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776489.884160:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1876716471499264:12345-0@lo:400:kworker.0 Request processed in 42us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776489.884166:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789776489.884515:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bff61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3275:1876716471499264:0@lo:400:kworker.0 00000100:00080000:0.0:1789776489.884535:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789776490.389095:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789776490.389132:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bff62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471499520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789776490.389309:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776490.389664:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471499520 00000100:00100000:1.0:1789776490.389676:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471499520 00000100:00100000:1.0:1789776490.389740:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00010000:00010000:3.0:1789776490.390170:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776490.390362:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471499520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789776490.390428:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789776490.390522:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471499520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 769us (1212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776490.390531:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1789776490.390822:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bff62d80 x1876716471499520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776506 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776490.390849:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bff62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471499520:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789776491.412631:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776492.319584:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776492.319655:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776492.319697:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776492.319785:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462028288 00000100:00100000:2.0:1789776492.319797:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462028288 00000100:00100000:2.0:1789776492.319853:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 224 00000100:00100000:2.0:1789776492.319864:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa596450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:2354:x1876716462028288:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1789776492.319943:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa596450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:2354:x1876716462028288:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 82us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776492.319950:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 224 00000100:00100000:3.0:1789776492.320295:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462028416 00000100:00100000:3.0:1789776492.320300:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462028416 00000100:00100000:3.0:1789776492.320346:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462028544 00000100:00100000:3.0:1789776492.320350:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462028544 00000100:00100000:3.0:1789776492.320371:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 81 00000100:00100000:3.0:1789776492.320378:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+6:2354:x1876716462028416:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1789776492.320420:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+6:2354:x1876716462028416:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 42us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776492.320427:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 81 00000100:00100000:3.0:1789776492.320440:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 82 00000100:00100000:3.0:1789776492.320454:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d27fff26-e747-430b-8151-cc0e7e6df617+5:2354:x1876716462028544:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1789776492.320484:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d27fff26-e747-430b-8151-cc0e7e6df617+5:2354:x1876716462028544:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 32us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776492.320491:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 82 00000100:00100000:0.0:1789776492.320592:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776492.320642:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00080000:2.0:1789776492.320857:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789776492.320990:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462028672 00000100:00100000:3.0:1789776492.320995:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462028672 00000100:00100000:3.0:1789776492.321040:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462028800 00000100:00100000:3.0:1789776492.321044:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462028800 00000100:00100000:3.0:1789776492.321067:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 14 00000100:00100000:3.0:1789776492.321075:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9deea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d27fff26-e747-430b-8151-cc0e7e6df617+5:2353:x1876716462028672:12345-192.168.202.6@tcp:9:kworker.0 00000020:00000080:3.0:1789776492.321098:0:6659:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x26940258de8ef15a 00000100:00080000:3.0:1789776492.321106:0:6659:0:(import.c:65:import_set_state_nolock()) ffff9c86ba89f800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789776492.321142:0:6659:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789776492.321624:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9deea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d27fff26-e747-430b-8151-cc0e7e6df617+2:2353:x1876716462028672:12345-192.168.202.6@tcp:9:kworker.0 Request processed in 549us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776492.321632:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 14 00000100:00100000:3.0:1789776492.321649:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 15 00000100:00100000:3.0:1789776492.321655:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9deca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d27fff26-e747-430b-8151-cc0e7e6df617+5:2353:x1876716462028800:12345-192.168.202.6@tcp:9:kworker.0 00000020:00000080:3.0:1789776492.321667:0:6659:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x26940258de8ef161 00000100:00080000:3.0:1789776492.321674:0:6659:0:(import.c:65:import_set_state_nolock()) ffff9c86bc8e0000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789776492.321698:0:6659:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789776492.321886:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9deca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d27fff26-e747-430b-8151-cc0e7e6df617+2:2353:x1876716462028800:12345-192.168.202.6@tcp:9:kworker.0 Request processed in 230us (1243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776492.321893:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 15 00010000:00010000:3.0:1789776492.321917:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789776492.322042:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789776492.322047:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789776492.322361:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776492.436623:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776493.466051:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776493.972590:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789776493.972631:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb4f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471499648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789776493.972717:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776493.973035:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471499648 00000100:00100000:1.0:1789776493.973045:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471499648 00000100:00100000:1.0:1789776493.973131:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789776493.973144:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471499648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789776493.973181:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789776493.973270:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471499648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776493.973278:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1789776493.973396:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789776493.973527:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bb4f3480 x1876716471499648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776509 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776493.973557:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb4f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471499648:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789776494.484933:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789776494.612577:0:7615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d27fff26-e747-430b-8151-cc0e7e6df617 00000020:00000080:0.0:1789776494.612588:0:7615:0:(genops.c:885:class_export_put()) final put ffff9c86bc8e2000/d27fff26-e747-430b-8151-cc0e7e6df617 00000020:00000080:3.0:1789776494.612713:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c86bc8e2000/d27fff26-e747-430b-8151-cc0e7e6df617 for lustre-OST0001 00000020:00000080:3.0:1789776494.612766:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c86bc8e0000 for lustre-OST0001 00000100:00100000:0.0:1789776494.996692:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf34ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471499776:0@lo:400:kworker.0 00000100:00100000:0.0:1789776494.996791:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776494.996845:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf34d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3275:1876716471500288:0@lo:400:kworker.0 00000100:00100000:0.0:1789776494.996873:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776494.996901:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789776494.996907:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf34d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3275:1876716471499904:0@lo:400:kworker.0 00000100:00100000:0.0:1789776494.996930:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776494.996949:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf34e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471500416:0@lo:400:kworker.0 00000100:00100000:0.0:1789776494.996973:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776494.997017:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471499776 00000100:00100000:0.0:1789776494.997024:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471499776 00000100:00100000:0.0:1789776494.997066:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789776494.997074:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa596050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+19:3275:x1876716471499776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776494.997120:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa596050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+19:3275:x1876716471499776:12345-0@lo:400:kworker.0 Request processed in 47us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776494.997127:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789776494.997158:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471500288 00000100:00100000:0.0:1789776494.997174:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471500288 00000100:00100000:0.0:1789776494.997206:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471499904 00000100:00100000:0.0:1789776494.997208:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471499904 00000100:00100000:0.0:1789776494.997251:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789776494.997257:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9dece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1876716471500288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776494.997286:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9dece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1876716471500288:12345-0@lo:400:kworker.0 Request processed in 29us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776494.997291:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789776494.997301:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789776494.997305:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1876716471499904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776494.997326:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1876716471499904:12345-0@lo:400:kworker.0 Request processed in 21us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776494.997331:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789776494.997349:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471500416 00000100:00100000:0.0:1789776494.997352:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471500416 00000100:00100000:0.0:1789776494.997375:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789776494.997380:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471500416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776494.997406:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471500416:12345-0@lo:400:kworker.0 Request processed in 26us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776494.997411:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1789776494.997424:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789776494.997429:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789776494.997462:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf34d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3275:1876716471499904:0@lo:400:kworker.0 00010000:00080000:0.0:1789776494.997474:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bf34e300 x1876716471500416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776494.997484:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf34e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471500416:0@lo:400:kworker.0 00000100:00100000:0.0:1789776494.997500:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf34ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471499776:0@lo:400:kworker.0 00000100:00100000:0.0:1789776494.997508:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf34d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3275:1876716471500288:0@lo:400:kworker.0 00000100:00100000:0.0:1789776494.997735:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf34ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471500160:0@lo:400:kworker.0 00000100:00100000:0.0:1789776494.997764:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776494.997785:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789776494.997790:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf34f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3274:1876716471500032:0@lo:400:kworker.0 00000100:00100000:0.0:1789776494.997810:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776494.997835:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471500160 00000100:00100000:0.0:1789776494.997839:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471500160 00000100:00100000:0.0:1789776494.997862:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789776494.997868:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471500160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776494.997903:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471500160:12345-0@lo:400:kworker.0 Request processed in 35us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776494.997908:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1789776494.997932:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bf34ca80 x1876716471500160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776494.997942:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf34ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471500160:0@lo:400:kworker.0 00000100:00100000:0.0:1789776494.997957:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471500032 00000100:00100000:0.0:1789776494.997961:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471500032 00000100:00100000:0.0:1789776494.997988:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789776494.997994:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1876716471500032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776494.998030:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1876716471500032:12345-0@lo:400:kworker.0 Request processed in 37us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776494.998036:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:0.0:1789776494.998059:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789776494.998076:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf34f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3274:1876716471500032:0@lo:400:kworker.0 00000001:00100000:2.0:1789776495.114396:0:6684:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d27fff26-e747-430b-8151-cc0e7e6df617 00000020:00000080:2.0:1789776495.114407:0:6684:0:(genops.c:885:class_export_put()) final put ffff9c86ba89f000/d27fff26-e747-430b-8151-cc0e7e6df617 00000020:00000080:3.0:1789776495.114675:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c86ba89f000/d27fff26-e747-430b-8151-cc0e7e6df617 for lustre-OST0000 00000020:00000080:3.0:1789776495.114864:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c86ba89f800 for lustre-OST0000 00010000:00010000:3.0:1789776495.509133:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776495.510768:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bff60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471500544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789776495.510844:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776495.510922:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471500544 00000100:00100000:1.0:1789776495.510929:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471500544 00000100:00100000:1.0:1789776495.510973:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789776495.510983:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bff62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471500544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789776495.511029:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789776495.511072:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bff62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471500544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776495.511079:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1789776495.511136:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bff60380 x1876716471500544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776511 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776495.511156:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bff60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471500544:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789776496.532516:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776497.457152:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776497.457184:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776497.457203:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776497.457247:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462028928 00000100:00100000:3.0:1789776497.457257:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462028928 00000100:00100000:3.0:1789776497.457305:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 226 00000100:00100000:3.0:1789776497.457314:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa595c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:2354:x1876716462028928:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1789776497.457375:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa595c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:2354:x1876716462028928:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 63us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776497.457383:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 226 00000100:00100000:3.0:1789776497.457414:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462029184 00000100:00100000:3.0:1789776497.457417:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462029184 00000100:00100000:3.0:1789776497.457445:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462029056 00000100:00100000:3.0:1789776497.457448:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462029056 00000100:00100000:3.0:1789776497.457466:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 86 00000100:00100000:3.0:1789776497.457472:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d27fff26-e747-430b-8151-cc0e7e6df617+5:2354:x1876716462029184:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1789776497.457512:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d27fff26-e747-430b-8151-cc0e7e6df617+5:2354:x1876716462029184:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 40us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776497.457529:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 86 00000100:00100000:3.0:1789776497.457542:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 87 00000100:00100000:3.0:1789776497.457548:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+6:2354:x1876716462029056:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1789776497.457567:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+6:2354:x1876716462029056:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 20us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776497.457573:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 87 00000100:00080000:3.0:1789776497.457684:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789776497.556456:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789776497.651685:0:10991:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1789776498.580653:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776499.103165:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789776499.103262:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf34f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471500672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789776499.103350:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776499.103638:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471500672 00000100:00100000:2.0:1789776499.103649:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471500672 00000100:00100000:2.0:1789776499.103733:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789776499.103743:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471500672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789776499.103777:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789776499.103821:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471500672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776499.103828:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1789776499.103991:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789776499.104024:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bf34f480 x1876716471500672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776515 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776499.104044:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf34f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471500672:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789776499.608584:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776500.119918:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a01dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471501184:0@lo:400:kworker.0 00000100:00100000:0.0:1789776500.119990:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776500.120048:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789776500.120053:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a01df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3274:1876716471501056:0@lo:400:kworker.0 00000100:00100000:3.0:1789776500.120257:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a01de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876716471500928:0@lo:400:kworker.0 00000100:00100000:3.0:1789776500.120286:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776500.120318:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa654700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471501440:0@lo:400:kworker.0 00000100:00100000:3.0:1789776500.120357:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776500.120376:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789776500.120381:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a01dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9db43398-240e-4f78-8778-c11d527e09a1:3276:1876716471500800:0@lo:400:kworker.0 00000100:00100000:3.0:1789776500.120403:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776500.120422:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a01dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3276:1876716471501312:0@lo:400:kworker.0 00000100:00100000:3.0:1789776500.120457:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776500.120486:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471500928 00000100:00100000:3.0:1789776500.120503:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471500928 00000100:00100000:3.0:1789776500.120551:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471501312 00000100:00100000:3.0:1789776500.120554:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471501312 00000100:00100000:3.0:1789776500.120583:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789776500.120592:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876716471500928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776500.120645:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876716471500928:12345-0@lo:400:kworker.0 Request processed in 54us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776500.120653:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789776500.120682:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789776500.120688:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876716471501312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776500.120717:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876716471501312:12345-0@lo:400:kworker.0 Request processed in 29us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776500.120722:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789776500.120739:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471501184 00000100:00100000:3.0:1789776500.120742:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471501184 00000100:00100000:3.0:1789776500.120766:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471501440 00000100:00100000:3.0:1789776500.120768:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471501440 00000100:00100000:3.0:1789776500.120788:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789776500.120793:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa657480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471501184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776500.120824:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa657480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471501184:12345-0@lo:400:kworker.0 Request processed in 31us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776500.120829:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789776500.120839:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789776500.120844:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf294e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471501440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776500.120866:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf294e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471501440:12345-0@lo:400:kworker.0 Request processed in 22us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776500.120878:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789776500.120896:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471500800 00000100:00100000:3.0:1789776500.120900:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471500800 00000100:00100000:3.0:1789776500.120923:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1789776500.120929:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa595850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+19:3276:x1876716471500800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776500.120959:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa595850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+19:3276:x1876716471500800:12345-0@lo:400:kworker.0 Request processed in 31us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776500.120964:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00080000:3.0:1789776500.120994:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789776500.120998:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789776500.121034:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a01dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9db43398-240e-4f78-8778-c11d527e09a1:3276:1876716471500800:0@lo:400:kworker.0 00000100:00100000:3.0:1789776500.121047:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a01dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3276:1876716471501312:0@lo:400:kworker.0 00000100:00100000:3.0:1789776500.121055:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a01de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876716471500928:0@lo:400:kworker.0 00010000:00080000:3.0:1789776500.121066:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86aa654700 x1876716471501440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776500.121087:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa654700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471501440:0@lo:400:kworker.0 00000100:00100000:0.0:1789776500.124788:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789776500.124878:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86a01dd180 x1876716471501184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776500.124895:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a01dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471501184:0@lo:400:kworker.0 00000100:00100000:3.0:1789776500.125380:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471501056 00000100:00100000:3.0:1789776500.125388:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471501056 00000100:00100000:3.0:1789776500.125478:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789776500.125489:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa655c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1876716471501056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776500.125582:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa655c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1876716471501056:12345-0@lo:400:kworker.0 Request processed in 95us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776500.125589:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789776500.125625:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a01df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3274:1876716471501056:0@lo:400:kworker.0 00000100:00080000:0.0:1789776500.125802:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789776500.629476:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776500.629601:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bff60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471501568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789776500.629692:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776500.629774:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471501568 00000100:00100000:2.0:1789776500.629782:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471501568 00000100:00100000:2.0:1789776500.629844:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789776500.629855:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf34ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471501568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789776500.629899:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789776500.629944:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf34ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471501568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776500.629952:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1789776500.629997:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bff60380 x1876716471501568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776516 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776500.630031:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bff60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471501568:0@lo:13:osp-pre-1-0.0 00000020:00000080:2.0:1789776501.493421:0:11140:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc71abb0e0 20000000:00000080:2.0:1789776501.493440:0:11140:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c86bf283400 uarg=0000000000000000 20000000:01000000:2.0:1789776501.493478:0:11140:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789776501.493562:0:11140:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789776501.493567:0:11140:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789776501.495368:0:11141:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1789776501.495568:0:11140:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789776501.503427:0:11140:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789776501.504551:0:11140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c8680030200/0x26940258de8ef168 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776501.504576:0:11140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c8681679c00/0x26940258de8ef10d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c262f expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776501.504586:0:11140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c86bf5cbc00/0x26940258de8ef11b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8ef114 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776501.504594:0:11140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c8681679400/0x26940258de8ef129 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8ef122 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776501.504601:0:11140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c868afc7e00/0x26940258de8ef137 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8ef130 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776501.504620:0:11140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c8680031400/0x26940258de8ef14c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2667 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776501.504629:0:11140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c8680030200/0x26940258de8ef168 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776501.504686:0:11140:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c8680031400/0x26940258de8ef14c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2667 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776501.504704:0:11140:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c8680031400/0x26940258de8ef14c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2667 expref: 12 pid: 5806 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776501.504720:0:11140:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa655f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11140:1876716471501696:192.168.202.6@tcp:104: 00010000:00010000:0.0:1789776501.504845:0:11140:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c868afc7e00/0x26940258de8ef137 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26940258de8ef130 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776501.504854:0:11140:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c868afc7e00/0x26940258de8ef137 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26940258de8ef130 expref: 18 pid: 5806 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776501.504863:0:11140:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa654380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11140:1876716471501824:0@lo:104: 00000100:00100000:0.0:1789776501.504906:0:11140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789776501.504961:0:11140:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c8681679400/0x26940258de8ef129 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26940258de8ef122 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776501.504968:0:11140:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c8681679400/0x26940258de8ef129 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26940258de8ef122 expref: 18 pid: 5804 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776501.504977:0:11140:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6c9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11140:1876716471501952:0@lo:104: 00000100:00100000:0.0:1789776501.505006:0:11140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789776501.505033:0:11140:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c86bf5cbc00/0x26940258de8ef11b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26940258de8ef114 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776501.505041:0:11140:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c86bf5cbc00/0x26940258de8ef11b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26940258de8ef114 expref: 18 pid: 5805 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776501.505049:0:11140:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6c8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11140:1876716471502080:0@lo:104: 00000100:00100000:0.0:1789776501.505082:0:11140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789776501.505100:0:11140:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c8681679c00/0x26940258de8ef10d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c262f expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776501.505109:0:11140:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c8681679c00/0x26940258de8ef10d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c262f expref: 12 pid: 5804 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776501.505117:0:11140:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6c9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11140:1876716471502208:192.168.202.6@tcp:104: 00000100:00100000:0.0:1789776501.505142:0:11140:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86af571a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789776501.510312:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471501824 00000100:00100000:3.0:1789776501.510328:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471501824 00000100:00100000:3.0:1789776501.510426:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471501952 00000100:00100000:3.0:1789776501.510430:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471501952 00000100:00100000:3.0:1789776501.510442:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471502080 00000100:00100000:3.0:1789776501.510445:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471502080 00000100:00100000:3.0:1789776501.510460:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789776501.510469:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa654700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9db43398-240e-4f78-8778-c11d527e09a1+5:11140:x1876716471501824:12345-0@lo:104: 00010000:00010000:3.0:1789776501.510498:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c86bf5ca200/0x26940258de8ef130 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8ef137 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776501.510625:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789776501.510632:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa654700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9db43398-240e-4f78-8778-c11d527e09a1+5:11140:x1876716471501824:12345-0@lo:104: Request processed in 164us (5726us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776501.510640:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789776501.510661:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789776501.510666:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9db43398-240e-4f78-8778-c11d527e09a1+4:11140:x1876716471501952:12345-0@lo:104: 00010000:00010000:3.0:1789776501.510842:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c868afc6a00/0x26940258de8ef122 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8ef129 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776501.510885:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789776501.510890:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9db43398-240e-4f78-8778-c11d527e09a1+4:11140:x1876716471501952:12345-0@lo:104: Request processed in 224us (5883us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776501.510896:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789776501.510911:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789776501.510917:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9db43398-240e-4f78-8778-c11d527e09a1+3:11140:x1876716471502080:12345-0@lo:104: 00010000:00010000:3.0:1789776501.510924:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c868afc7000/0x26940258de8ef114 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8ef11b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776501.510980:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789776501.510985:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9db43398-240e-4f78-8778-c11d527e09a1+3:11140:x1876716471502080:12345-0@lo:104: Request processed in 69us (5903us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776501.510991:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1789776501.511014:0:8421:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789776501.511021:0:8421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c86bf5ca200/0x26940258de8ef130 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8ef137 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776501.511028:0:8421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5ca200 already unused, calling callback (ffffffffc1da0c20) 10000000:00010000:3.0:1789776501.511033:0:8421:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c86bf5ca200/0x26940258de8ef130 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x26940258de8ef137 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776501.511041:0:8421:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c86bf5ca200/0x26940258de8ef130 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x26940258de8ef137 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789776501.511047:0:8421:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c86bf5ca200/0x26940258de8ef130 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x26940258de8ef137 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776501.511053:0:8421:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789776501.511088:0:8421:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c86bf5ca200/0x26940258de8ef130 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8ef137 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776501.511096:0:8421:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789776501.511116:0:8421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c86bf5ca200/0x26940258de8ef130 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8ef137 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776501.511123:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c86bf5ca200/0x26940258de8ef130 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8ef137 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776501.511148:0:8421:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789776501.511152:0:8421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c868afc6a00/0x26940258de8ef122 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8ef129 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776501.511157:0:8421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc6a00 already unused, calling callback (ffffffffc1da0c20) 10000000:00010000:3.0:1789776501.511160:0:8421:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c868afc6a00/0x26940258de8ef122 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x26940258de8ef129 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776501.511166:0:8421:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c868afc6a00/0x26940258de8ef122 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x26940258de8ef129 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789776501.511172:0:8421:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c868afc6a00/0x26940258de8ef122 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x26940258de8ef129 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776501.511177:0:8421:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789776501.511190:0:8421:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c868afc6a00/0x26940258de8ef122 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8ef129 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776501.511196:0:8421:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789776501.511383:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776501.511390:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c868afc7000/0x26940258de8ef114 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8ef11b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776501.511398:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc7000 already unused, calling callback (ffffffffc1da0c20) 10000000:00010000:1.0:1789776501.511401:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c868afc7000/0x26940258de8ef114 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x26940258de8ef11b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776501.511407:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c868afc7000/0x26940258de8ef114 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x26940258de8ef11b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789776501.511413:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c868afc7000/0x26940258de8ef114 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x26940258de8ef11b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776501.511418:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789776501.511439:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c868afc7000/0x26940258de8ef114 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8ef11b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776501.511445:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789776501.511460:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c868afc7000/0x26940258de8ef114 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8ef11b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776501.511467:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c868afc7000/0x26940258de8ef114 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8ef11b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776501.511477:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776501.511478:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776501.511480:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776501.512253:0:11140:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa655f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11140:1876716471501696:192.168.202.6@tcp:104: 00000100:00100000:0.0:1789776501.512270:0:11140:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa654380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11140:1876716471501824:0@lo:104: 00000100:00100000:0.0:1789776501.512279:0:11140:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6c9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11140:1876716471501952:0@lo:104: 00000100:00100000:0.0:1789776501.512287:0:11140:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6c8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11140:1876716471502080:0@lo:104: 00000100:00100000:2.0:1789776501.512379:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9db43398-240e-4f78-8778-c11d527e09a1:3274:1876716471502336:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789776501.512407:0:8421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c868afc6a00/0x26940258de8ef122 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8ef129 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776501.512418:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c868afc6a00/0x26940258de8ef122 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8ef129 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776501.512435:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776501.512435:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789776501.512437:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776501.512439:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776501.512455:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf294a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471502464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789776501.512505:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789776501.512538:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776501.512555:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bff61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9db43398-240e-4f78-8778-c11d527e09a1:3276:1876716471502592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789776501.515689:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776501.515889:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776501.515922:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471502336 00000100:00100000:3.0:1789776501.515931:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471502336 00010000:00010000:3.0:1789776501.515969:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c868afc7e00/0x26940258de8ef137 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8ef130 expref: 19 pid: 5806 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776501.515991:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471502464 00000100:00100000:3.0:1789776501.515994:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471502464 00010000:00010000:3.0:1789776501.516007:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c8681679400/0x26940258de8ef129 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8ef122 expref: 20 pid: 5804 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776501.516018:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471502592 00000100:00100000:3.0:1789776501.516021:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471502592 00010000:00010000:3.0:1789776501.516030:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c86bf5cbc00/0x26940258de8ef11b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8ef114 expref: 21 pid: 5805 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776501.516039:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462029312 00000100:00100000:3.0:1789776501.516042:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462029312 00010000:00010000:3.0:1789776501.516125:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c8680031400/0x26940258de8ef14c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2667 expref: 13 pid: 5806 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776501.516145:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789776501.516154:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c869880e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9db43398-240e-4f78-8778-c11d527e09a1+21:3274:x1876716471502336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789776501.516171:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776501.516177:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c868afc7e00/0x26940258de8ef137 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8ef130 expref: 21 pid: 5806 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776501.516187:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c868afc7e00/0x26940258de8ef137 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26940258de8ef130 expref: 21 pid: 5806 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776501.516382:0:5796:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789776501.516392:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1789776501.516580:0:5795:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789776501.516899:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789776501.516907:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf296300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9db43398-240e-4f78-8778-c11d527e09a1+21:3275:x1876716471502464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789776501.516917:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776501.516922:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c8681679400/0x26940258de8ef129 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8ef122 expref: 21 pid: 5804 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776501.521916:0:11142:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1789776501.521930:0:11142:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:2.0:1789776501.522190:0:11142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789776501.522207:0:11142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9db43398-240e-4f78-8778-c11d527e09a1+21:3276:x1876716471502592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789776501.522242:0:11142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776501.522252:0:11142:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c86bf5cbc00/0x26940258de8ef11b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8ef114 expref: 21 pid: 5805 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776501.522262:0:11143:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 5 min 3 max 56 00000100:00100000:0.0:1789776501.522267:0:11143:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_005' 00010000:00010000:1.0:1789776501.522629:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c8681679400/0x26940258de8ef129 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26940258de8ef122 expref: 21 pid: 5804 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776501.522647:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c8681679400/0x26940258de8ef129 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26940258de8ef122 expref: 21 pid: 5804 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776501.522662:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789776501.522958:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c868afc7e00/0x26940258de8ef137 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26940258de8ef130 expref: 20 pid: 5806 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776501.522970:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776501.523035:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf296300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9db43398-240e-4f78-8778-c11d527e09a1+19:3275:x1876716471502464:12345-0@lo:103:ldlm_bl.0 Request processed in 6129us (10528us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776501.523044:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789776501.523073:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 28 00000100:00100000:1.0:1789776501.523082:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf295880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:2356:x1876716462029312:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776501.523092:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776501.523105:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c8680031400/0x26940258de8ef14c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2667 expref: 13 pid: 5806 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776501.523117:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c8680031400/0x26940258de8ef14c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2667 expref: 13 pid: 5806 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776501.523121:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00010000:1.0:1789776501.523129:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c8680031400/0x26940258de8ef14c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2667 expref: 13 pid: 5806 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776501.523138:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776501.523172:0:11140:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6c9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11140:1876716471502208:192.168.202.6@tcp:104: 00000100:00100000:1.0:1789776501.523177:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf295880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+12:2356:x1876716462029312:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 97us (7292us total) trans 0 rc 0/0 00010000:00010000:0.0:1789776501.523213:0:11140:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c8680030200/0x26940258de8ef168 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776501.523251:0:5796:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 5 min 3 max 56 00000100:00100000:0.0:1789776501.523259:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462029440 00000100:00100000:0.0:1789776501.523265:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462029440 00010000:00010000:0.0:1789776501.523283:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c8681679c00/0x26940258de8ef10d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c262f expref: 13 pid: 5804 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776501.523297:0:5796:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 5 min 3 max 56 00000100:00100000:0.0:1789776501.523316:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 29 00000100:00100000:0.0:1789776501.523324:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:2357:x1876716462029440:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789776501.523334:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776501.523338:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c8681679c00/0x26940258de8ef10d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c262f expref: 13 pid: 5804 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776501.523346:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c8681679c00/0x26940258de8ef10d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c262f expref: 13 pid: 5804 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776501.523356:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c8681679c00/0x26940258de8ef10d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c262f expref: 13 pid: 5804 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776501.523364:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776501.523381:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+12:2357:x1876716462029440:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 59us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776501.523387:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 29 00000100:00100000:1.0:1789776501.523863:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 28 00000100:00100000:3.0:1789776501.523929:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c869880e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9db43398-240e-4f78-8778-c11d527e09a1+18:3274:x1876716471502336:12345-0@lo:103:ldlm_bl.0 Request processed in 7775us (11493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776501.523938:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789776501.524169:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf294a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471502464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789776501.524198:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9db43398-240e-4f78-8778-c11d527e09a1:3274:1876716471502336:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789776501.524574:0:11142:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c86bf5cbc00/0x26940258de8ef11b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26940258de8ef114 expref: 17 pid: 5805 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776501.524590:0:11142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c86bf5cbc00/0x26940258de8ef11b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26940258de8ef114 expref: 17 pid: 5805 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776501.524602:0:11142:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c8680030200/0x26940258de8ef168 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776501.524781:0:11142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c8680030200/0x26940258de8ef168 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776501.524797:0:11142:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c8680030200/0x26940258de8ef168 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776501.524804:0:11142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c8680030200/0x26940258de8ef168 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776501.524811:0:11142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c8680030200/0x26940258de8ef168 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776501.524818:0:11142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c8680030200/0x26940258de8ef168 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776501.524824:0:11142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8680030200 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:2.0:1789776501.524828:0:11142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c8680030200/0x26940258de8ef168 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776501.524836:0:11142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c8680030200/0x26940258de8ef168 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776501.524937:0:11140:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c8680030200/0x26940258de8ef168 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776501.524944:0:11140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c8680030200/0x26940258de8ef168 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776501.525593:0:11142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c8680030200/0x26940258de8ef168 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776501.525606:0:11142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c8680030200/0x26940258de8ef168 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776501.525752:0:11142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776501.525829:0:11142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9db43398-240e-4f78-8778-c11d527e09a1+16:3276:x1876716471502592:12345-0@lo:103:ldlm_bl.0 Request processed in 3627us (10144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776501.525848:0:11142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789776501.525973:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bff61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9db43398-240e-4f78-8778-c11d527e09a1:3276:1876716471502592:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789776501.655766:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776502.559412:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776502.559470:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776502.559678:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462029568 00000100:00100000:0.0:1789776502.559690:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462029568 00000100:00100000:0.0:1789776502.559754:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 228 00000100:00100000:0.0:1789776502.559766:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa597850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+11:2355:x1876716462029568:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1789776502.559868:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa597850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+11:2355:x1876716462029568:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 104us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776502.559876:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 228 00000100:00100000:1.0:1789776502.560568:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462029696 00000100:00100000:1.0:1789776502.560575:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462029696 00000100:00100000:1.0:1789776502.560640:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 91 00000100:00100000:1.0:1789776502.560649:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf297480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+6:2355:x1876716462029696:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1789776502.560701:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf297480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+6:2355:x1876716462029696:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 54us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776502.560708:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 91 00000100:00080000:0.0:1789776502.560906:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789776502.563762:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776502.563946:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462029824 00000100:00100000:0.0:1789776502.563957:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462029824 00000100:00100000:0.0:1789776502.564043:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 92 00000100:00100000:0.0:1789776502.564054:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d27fff26-e747-430b-8151-cc0e7e6df617+5:2354:x1876716462029824:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1789776502.564145:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d27fff26-e747-430b-8151-cc0e7e6df617+5:2354:x1876716462029824:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 93us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776502.564154:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 92 00000100:00080000:3.0:1789776502.565893:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789776502.676557:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789776503.191168:0:5808:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789776503.191176:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c86af31b000 from 7 10000000:01000000:2.0:1789776503.191181:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789776503.191252:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c868afc7200/0x26940258de8ef16f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776503.191265:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c868afc7200/0x26940258de8ef16f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776503.191277:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c868afc7200/0x26940258de8ef16f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776503.191304:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf34d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471502720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789776503.191376:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776503.191426:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86aa47da80 going to sleep for 11 seconds 00000100:00100000:3.0:1789776503.191613:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471502720 00000100:00100000:3.0:1789776503.191622:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471502720 00000100:00100000:3.0:1789776503.191682:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1789776503.191692:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa596850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+16:5808:x1876716471502720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789776503.191706:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776503.191720:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c8681678a00/0x26940258de8ef176 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8ef16f expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776503.191743:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c8681678a00/0x26940258de8ef176 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8ef16f expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776503.191752:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c8681678a00/0x26940258de8ef176 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8ef16f expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776503.191777:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8681678a00, rc 0) 00000100:00100000:3.0:1789776503.191821:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa596850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+17:5808:x1876716471502720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776503.191827:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789776503.191929:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf34d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471502720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789776503.191946:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c868afc7200/0x26940258de8ef16f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef176 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776503.191955:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c868afc7200/0x26940258de8ef16f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8ef176 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776503.192020:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf34d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471502848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776503.192045:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776503.192101:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86aa47da80 going to sleep for 11 seconds 00000100:00100000:3.0:1789776503.195120:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471502848 00000100:00100000:3.0:1789776503.195135:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471502848 00000100:00100000:3.0:1789776503.195210:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1789776503.196156:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa597c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+17:5808:x1876716471502848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789776503.196684:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa597c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+17:5808:x1876716471502848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 536us (4634us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776503.196694:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789776503.198462:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf34d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471502848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789776503.198583:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6c9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471502976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789776503.198668:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776503.198731:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86af571000 going to sleep for 11 seconds 00000100:00100000:1.0:1789776503.199099:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471502976 00000100:00100000:1.0:1789776503.199107:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471502976 00000100:00100000:1.0:1789776503.199162:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1789776503.199172:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa594850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+17:5808:x1876716471502976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789776503.199444:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa594850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+17:5808:x1876716471502976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 272us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776503.199461:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1789776503.200863:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6c9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471502976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789776503.208258:0:11200:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789776503.208429:0:5808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789776503.208458:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789776503.208480:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c868afc7200/0x26940258de8ef16f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef176 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776503.208505:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c868afc7200/0x26940258de8ef16f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef176 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789776503.208516:0:5808:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789776503.208519:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c86903b8800 from 7 10000000:01000000:0.0:1789776503.208522:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789776503.208562:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8680030200/0x26940258de8ef17d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776503.208570:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c8680030200/0x26940258de8ef17d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776503.208580:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c8680030200/0x26940258de8ef17d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776503.208604:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6c9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471503104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789776503.208675:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776503.208721:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86af571000 going to sleep for 11 seconds 00000100:00100000:3.0:1789776503.208786:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471503104 00000100:00100000:3.0:1789776503.208794:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471503104 00000100:00100000:3.0:1789776503.208845:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789776503.208853:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa597450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+17:5808:x1876716471503104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789776503.208866:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776503.208879:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c8681678000/0x26940258de8ef184 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8ef17d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776503.208901:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c8681678000/0x26940258de8ef184 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8ef17d expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776503.208911:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c8681678000/0x26940258de8ef184 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8ef17d expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776503.208920:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8681678000, rc 0) 00000100:00100000:3.0:1789776503.208975:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa597450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+18:5808:x1876716471503104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776503.208982:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1789776503.209636:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6c9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471503104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789776503.209661:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c8680030200/0x26940258de8ef17d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef184 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776503.209673:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c8680030200/0x26940258de8ef17d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8ef184 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776503.209737:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6c9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471503232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789776503.209777:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776503.209820:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86af571000 going to sleep for 11 seconds 00000100:00100000:1.0:1789776503.209894:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471503232 00000100:00100000:1.0:1789776503.209900:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471503232 00000100:00100000:1.0:1789776503.209940:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1789776503.209950:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa594050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+18:5808:x1876716471503232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789776503.210250:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa594050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+18:5808:x1876716471503232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 300us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776503.210258:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1789776503.210399:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6c9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471503232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789776503.210429:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6c9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471503360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789776503.210467:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776503.210502:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86af571000 going to sleep for 11 seconds 00000100:00100000:1.0:1789776503.210574:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471503360 00000100:00100000:1.0:1789776503.210578:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471503360 00000100:00100000:1.0:1789776503.210610:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1789776503.210615:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa595050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+18:5808:x1876716471503360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789776503.210761:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa595050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+18:5808:x1876716471503360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776503.210768:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1789776503.210865:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6c9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471503360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789776503.215551:0:11201:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789776503.215746:0:5808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789776503.215765:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789776503.215777:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8680030200/0x26940258de8ef17d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef184 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776503.215789:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c8680030200/0x26940258de8ef17d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef184 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776503.215799:0:5808:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789776503.215802:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c86c01a7000 from 7 10000000:01000000:1.0:1789776503.215804:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789776503.215853:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c86bf5cba00/0x26940258de8ef18b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776503.215862:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c86bf5cba00/0x26940258de8ef18b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776503.215873:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c86bf5cba00/0x26940258de8ef18b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776503.215900:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bff61500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471503488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789776503.215979:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776503.216023:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86988d3480 going to sleep for 11 seconds 00000100:00100000:0.0:1789776503.216380:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471503488 00000100:00100000:0.0:1789776503.216388:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471503488 00000100:00100000:0.0:1789776503.216440:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1789776503.216450:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+18:5808:x1876716471503488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789776503.216462:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776503.216484:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c8680031400/0x26940258de8ef192 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8ef18b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776503.216511:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c8680031400/0x26940258de8ef192 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8ef18b expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776503.216522:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c8680031400/0x26940258de8ef192 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8ef18b expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776503.216531:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8680031400, rc 0) 00000100:00100000:0.0:1789776503.216589:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+19:5808:x1876716471503488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776503.216596:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1789776503.216692:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bff61500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471503488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789776503.216707:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c86bf5cba00/0x26940258de8ef18b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef192 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776503.216715:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c86bf5cba00/0x26940258de8ef18b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8ef192 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776503.216770:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf297100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471503616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789776503.216802:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776503.216839:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86af77df00 going to sleep for 11 seconds 00000100:00100000:1.0:1789776503.216898:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471503616 00000100:00100000:1.0:1789776503.216903:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471503616 00000100:00100000:1.0:1789776503.216932:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789776503.216939:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+19:5808:x1876716471503616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789776503.217205:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+19:5808:x1876716471503616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 265us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776503.217212:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789776503.217269:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf297100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471503616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789776503.217296:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bff62680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471503744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789776503.217333:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776503.217346:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86988d3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789776503.217356:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471503744 00000100:00100000:1.0:1789776503.217359:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471503744 00000100:00100000:1.0:1789776503.217374:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789776503.217379:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa594c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+19:5808:x1876716471503744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789776503.217534:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa594c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+19:5808:x1876716471503744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776503.217541:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789776503.217576:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bff62680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471503744:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789776503.218326:0:11202:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789776503.218377:0:5808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789776503.218398:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789776503.218407:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c86bf5cba00/0x26940258de8ef18b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef192 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776503.218417:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c86bf5cba00/0x26940258de8ef18b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef192 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776503.452904:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776503.453039:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462029952 00000100:00100000:0.0:1789776503.453052:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462029952 00000100:00100000:0.0:1789776503.453149:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 238 00000100:00100000:0.0:1789776503.453171:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa593c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+11:5598:x1876716462029952:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789776503.453191:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776503.453330:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c8680031600/0x26940258de8ef199 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2691 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776503.453367:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c8680031600/0x26940258de8ef199 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2691 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776503.453381:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c8680031600/0x26940258de8ef199 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2691 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776503.453391:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8680031600, rc 0) 00000100:00100000:0.0:1789776503.454286:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa593c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+12:5598:x1876716462029952:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 1120us (1386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776503.454297:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 238 00000100:00100000:3.0:1789776503.459116:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776503.459698:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462030080 00000100:00100000:0.0:1789776503.459709:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462030080 00000100:00100000:0.0:1789776503.459785:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 239 00000100:00100000:0.0:1789776503.459796:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa590850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+12:5598:x1876716462030080:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789776503.460113:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa590850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+12:5598:x1876716462030080:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 318us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776503.460122:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 239 00000100:00100000:3.0:1789776503.470740:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776503.471165:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462030208 00000100:00100000:0.0:1789776503.471177:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462030208 00000100:00100000:0.0:1789776503.471258:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 240 00000100:00100000:0.0:1789776503.471372:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+12:5598:x1876716462030208:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789776503.471612:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+12:5598:x1876716462030208:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 Request processed in 345us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776503.471620:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 240 00000100:00100000:0.0:1789776503.477383:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776503.477425:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462030336 00000100:00100000:0.0:1789776503.477435:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462030336 00000100:00100000:0.0:1789776503.477501:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 241 00000100:00100000:0.0:1789776503.477511:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa590050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+12:5598:x1876716462030336:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789776503.477531:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776503.477549:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c86813a1a00/0x26940258de8ef1a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2698 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776503.477577:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c86813a1a00/0x26940258de8ef1a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2698 expref: 13 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776503.477588:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c86813a1a00/0x26940258de8ef1a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2698 expref: 13 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776503.477597:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86813a1a00, rc 0) 00000100:00100000:0.0:1789776503.477647:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa590050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:5598:x1876716462030336:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 138us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776503.477654:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 241 00000100:00100000:1.0:1789776503.488112:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776503.489242:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462030464 00000100:00100000:3.0:1789776503.489255:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462030464 00000100:00100000:3.0:1789776503.489311:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 242 00000100:00100000:3.0:1789776503.489322:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:5598:x1876716462030464:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789776503.489634:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:5598:x1876716462030464:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 313us (1535us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776503.489643:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 242 00000100:00100000:0.0:1789776503.498154:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776503.499818:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462030592 00000100:00100000:3.0:1789776503.499833:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462030592 00000100:00100000:3.0:1789776503.499899:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 243 00000100:00100000:3.0:1789776503.499911:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:5598:x1876716462030592:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789776503.500167:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:5598:x1876716462030592:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 Request processed in 258us (2024us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776503.500174:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 243 00010000:00010000:1.0:1789776503.700341:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776504.212386:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789776504.212412:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471503872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789776504.212498:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776504.212565:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471503872 00000100:00100000:3.0:1789776504.212579:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471503872 00000100:00100000:3.0:1789776504.215640:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789776504.215665:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf295f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471503872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789776504.215708:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789776504.215785:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf295f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471503872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (3287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776504.215805:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1789776504.215838:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789776504.215877:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bf296a00 x1876716471503872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776520 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776504.215898:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471503872:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789776504.724568:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776505.241885:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bff62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471504384:0@lo:400:kworker.0 00000100:00100000:1.0:1789776505.241988:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776505.242362:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789776505.242371:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bff62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9db43398-240e-4f78-8778-c11d527e09a1:3273:1876716471504000:0@lo:400:kworker.0 00000100:00100000:1.0:1789776505.242404:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776505.242428:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bff62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3273:1876716471504512:0@lo:400:kworker.0 00000100:00100000:1.0:1789776505.242462:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776505.242572:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bff63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3275:1876716471504128:0@lo:400:kworker.0 00000100:00100000:1.0:1789776505.242599:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776505.242752:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bff63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471504640:0@lo:400:kworker.0 00000100:00100000:1.0:1789776505.242794:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776505.242815:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789776505.242821:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bff60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3275:1876716471504256:0@lo:400:kworker.0 00000100:00100000:1.0:1789776505.242841:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776505.242879:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471504384 00000100:00100000:1.0:1789776505.242886:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471504384 00000100:00100000:2.0:1789776505.243395:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471504512 00000100:00100000:2.0:1789776505.243409:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471504512 00000100:00100000:2.0:1789776505.243445:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471504128 00000100:00100000:2.0:1789776505.243447:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471504128 00000100:00100000:2.0:1789776505.243473:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471504256 00000100:00100000:2.0:1789776505.243475:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471504256 00000100:00100000:2.0:1789776505.243502:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789776505.243513:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bff60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1876716471504512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776505.243572:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bff60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1876716471504512:12345-0@lo:400:kworker.0 Request processed in 61us (1118us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776505.243579:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789776505.243595:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789776505.243601:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bff60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1876716471504128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776505.243645:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bff60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1876716471504128:12345-0@lo:400:kworker.0 Request processed in 44us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776505.243650:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789776505.243661:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789776505.243667:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bff60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1876716471504256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776505.243704:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bff60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1876716471504256:12345-0@lo:400:kworker.0 Request processed in 38us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776505.243709:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:2.0:1789776505.243726:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789776505.243758:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bff60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3275:1876716471504256:0@lo:400:kworker.0 00000100:00100000:2.0:1789776505.243768:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bff63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3275:1876716471504128:0@lo:400:kworker.0 00000100:00100000:2.0:1789776505.243799:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bff62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3273:1876716471504512:0@lo:400:kworker.0 00000100:00100000:1.0:1789776505.244316:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471504640 00000100:00100000:1.0:1789776505.244321:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471504640 00000100:00100000:1.0:1789776505.244368:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789776505.244377:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bff61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471504384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776505.244420:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bff61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471504384:12345-0@lo:400:kworker.0 Request processed in 45us (2432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776505.244425:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789776505.244439:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789776505.244445:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bff61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471504640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776505.245004:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bff61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471504640:12345-0@lo:400:kworker.0 Request processed in 555us (2206us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776505.245012:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1789776505.245765:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789776505.245874:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bff63100 x1876716471504640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776505.246309:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471504000 00000100:00100000:1.0:1789776505.246316:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471504000 00000100:00100000:1.0:1789776505.246365:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1789776505.246374:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa591450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+19:3273:x1876716471504000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776505.246597:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bff63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471504640:0@lo:400:kworker.0 00000100:00100000:2.0:1789776505.247318:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bff62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9db43398-240e-4f78-8778-c11d527e09a1:3273:1876716471504000:0@lo:400:kworker.0 00010000:00080000:2.0:1789776505.247335:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bff62a00 x1876716471504384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776505.247345:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bff62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471504384:0@lo:400:kworker.0 00000100:00100000:1.0:1789776505.247771:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa591450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+19:3273:x1876716471504000:12345-0@lo:400:kworker.0 Request processed in 1397us (5364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776505.247781:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00010000:00010000:1.0:1789776505.748334:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776505.753047:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bff62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471504768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789776505.753126:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776505.753367:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471504768 00000100:00100000:1.0:1789776505.753385:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471504768 00000100:00100000:1.0:1789776505.753440:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789776505.753458:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471504768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789776505.753495:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789776505.753551:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471504768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776505.753558:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1789776505.753661:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bff62a00 x1876716471504768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776521 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776505.753686:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bff62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471504768:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1789776505.761349:0:11341:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789776506.778752:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776507.701247:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776507.701280:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776507.701302:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776507.701330:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462030720 00000100:00100000:0.0:1789776507.701339:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462030720 00000100:00100000:0.0:1789776507.701383:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 245 00000100:00100000:0.0:1789776507.701393:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa593050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:2356:x1876716462030720:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1789776507.701472:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa593050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:2356:x1876716462030720:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 81us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776507.701481:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 245 00000100:00100000:0.0:1789776507.701516:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462030976 00000100:00100000:0.0:1789776507.701519:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462030976 00000100:00100000:0.0:1789776507.701549:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462030848 00000100:00100000:0.0:1789776507.701551:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462030848 00000100:00100000:0.0:1789776507.701570:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 96 00000100:00100000:0.0:1789776507.701577:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d27fff26-e747-430b-8151-cc0e7e6df617+5:2356:x1876716462030976:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1789776507.701604:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d27fff26-e747-430b-8151-cc0e7e6df617+5:2356:x1876716462030976:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 28us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776507.701610:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 96 00000100:00100000:0.0:1789776507.701622:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 97 00000100:00100000:0.0:1789776507.701627:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+6:2356:x1876716462030848:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1789776507.701649:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+6:2356:x1876716462030848:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 22us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776507.701663:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 97 00000100:00080000:0.0:1789776507.701780:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789776507.796382:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776508.820602:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789776509.269461:0:11440:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 20:08:28 (1789776508) === 00000100:00100000:3.0:1789776509.333336:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789776509.333358:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471504896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789776509.333443:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776509.333508:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471504896 00000100:00100000:3.0:1789776509.333515:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471504896 00000100:00100000:3.0:1789776509.333572:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789776509.333580:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf297800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471504896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789776509.333641:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789776509.333684:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf297800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471504896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776509.333692:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1789776509.333713:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789776509.333743:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bf296a00 x1876716471504896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776525 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776509.333763:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471504896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789776509.465258:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776509.465298:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776509.465334:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462031104 00000100:00100000:3.0:1789776509.465343:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462031104 00000100:00100000:3.0:1789776509.465399:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 14 00000100:00100000:3.0:1789776509.465408:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+6:2357:x1876716462031104:12345-192.168.202.6@tcp:41:mkdir.0 00000004:00000024:3.0:1789776509.465459:0:8177:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789776509.465537:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+6:2357:x1876716462031104:12345-192.168.202.6@tcp:41:mkdir.0 Request processed in 131us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776509.465545:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 14 00000100:00080000:3.0:1789776509.465565:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789776509.465964:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462031232 00000100:00100000:0.0:1789776509.465969:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462031232 00000100:00100000:0.0:1789776509.465999:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 0 00000100:00100000:0.0:1789776509.466006:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf296a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0795fb8a-e14a-4768-806c-f332ad101de7+6:9675:x1876716462031232:12345-192.168.202.6@tcp:700:mkdir.0 00000100:00100000:0.0:1789776509.466048:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf296a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0795fb8a-e14a-4768-806c-f332ad101de7+6:9675:x1876716462031232:12345-192.168.202.6@tcp:700:mkdir.0 Request processed in 43us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776509.466055:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 0 00000100:00100000:3.0:1789776509.481539:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776509.481571:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462031488 00000100:00100000:3.0:1789776509.481581:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462031488 00000100:00100000:3.0:1789776509.481627:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 15 00000100:00100000:3.0:1789776509.481636:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf296d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+6:9675:x1876716462031488:12345-192.168.202.6@tcp:36:mkdir.0 00010000:00010000:3.0:1789776509.481689:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776509.481769:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef088 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c261a expref: 6 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.481795:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c8683789b00) 00010000:00010000:3.0:1789776509.481809:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789776509.482146:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8ef1a7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.482158:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8ef1a7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.482167:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8ef1a7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.482191:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8ef1ae lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.482198:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8ef1ae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.482204:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8ef1ae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776509.483278:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789776509.483291:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8ef1a7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.483300:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8ef1a7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.483308:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8ef1a7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.483314:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681678800 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776509.483323:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8ef1a7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.483332:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8ef1a7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.483345:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c8682cbe900) 00010000:00010000:3.0:1789776509.483348:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776509.483351:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8ef1a7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.483358:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8ef1a7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789776509.483372:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000496af574 reply state 0000000008ab7ee3 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8ef1ae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776509.483381:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789776509.483490:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf296d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+7:9675:x1876716462031488:12345-192.168.202.6@tcp:36:mkdir.0 Request processed in 1852us (1957us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789776509.483499:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 15 00010000:00010000:2.0:1789776509.497124:0:3259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8ef1ae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.497143:0:3259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8ef1ae lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.497152:0:3259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8ef1ae lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.497159:0:3259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681679000 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776509.497164:0:3259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8ef1ae lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.497172:0:3259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8ef1ae lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.497191:0:3259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c8682cbe500) 00010000:00010000:2.0:1789776509.497195:0:3259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776509.497199:0:3259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8ef1ae lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.497254:0:3259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8ef1ae lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776509.499799:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776509.500194:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462031616 00000100:00100000:3.0:1789776509.500204:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462031616 00000100:00100000:0.0:1789776509.500661:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 16 00000100:00100000:0.0:1789776509.500673:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+6:9676:x1876716462031616:12345-192.168.202.6@tcp:101:chmod.0 00010000:00010000:0.0:1789776509.500692:0:8177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776509.500715:0:8177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0000/0x26940258de8ef1b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c269f expref: -99 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.500777:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0200/0x26940258de8ef1bc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.500791:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0200/0x26940258de8ef1bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.500802:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0200/0x26940258de8ef1bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776509.500837:0:8177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789776509.500840:0:8177:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789776509.501013:0:8177:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0200/0x26940258de8ef1bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.501039:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0000/0x26940258de8ef1b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c269f expref: 8 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.501057:0:8177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0200/0x26940258de8ef1bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c269f expref: 7 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.501066:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c86a08df300) 00010000:00010000:0.0:1789776509.501079:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789776509.501083:0:8177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86813a0200, rc 0) 00000100:00100000:0.0:1789776509.501148:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+7:9676:x1876716462031616:12345-192.168.202.6@tcp:101:chmod.0 Request processed in 477us (1361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776509.501155:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 16 00000100:00100000:0.0:1789776509.505743:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776509.506078:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462031872 00000100:00100000:3.0:1789776509.506088:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462031872 00000100:00100000:3.0:1789776509.506156:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 17 00000100:00100000:3.0:1789776509.506166:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+7:9676:x1876716462031872:12345-192.168.202.6@tcp:36:chmod.0 00010000:00010000:3.0:1789776509.506247:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776509.506274:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0200/0x26940258de8ef1bc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c269f expref: 7 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.506306:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c86a08df300) 00010000:00010000:3.0:1789776509.506885:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789776509.506978:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7e00/0x26940258de8ef1c3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.507001:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7e00/0x26940258de8ef1c3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.507011:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7e00/0x26940258de8ef1c3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789776509.507607:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000764068fd reply state 000000003a3c5a27 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7e00/0x26940258de8ef1c3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776509.507616:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789776509.507625:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789776509.507719:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+8:9676:x1876716462031872:12345-192.168.202.6@tcp:36:chmod.0 Request processed in 1553us (1983us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789776509.507728:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 17 00010000:00010000:1.0:1789776509.509364:0:3260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7e00/0x26940258de8ef1c3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776509.509377:0:3260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7e00/0x26940258de8ef1c3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776509.509385:0:3260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7e00/0x26940258de8ef1c3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776509.509392:0:3260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc7e00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776509.509397:0:3260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7e00/0x26940258de8ef1c3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776509.509404:0:3260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7e00/0x26940258de8ef1c3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776509.509429:0:3260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c86881a7300) 00010000:00010000:1.0:1789776509.509433:0:3260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789776509.509437:0:3260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7e00/0x26940258de8ef1c3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776509.509458:0:3260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7e00/0x26940258de8ef1c3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776509.545616:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776509.545718:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462032000 00000100:00100000:3.0:1789776509.545728:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462032000 00000100:00100000:3.0:1789776509.545817:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 18 00000100:00100000:3.0:1789776509.545829:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+7:9677:x1876716462032000:12345-192.168.202.6@tcp:101:chown.0 00010000:00010000:3.0:1789776509.545851:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776509.545874:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678c00/0x26940258de8ef1ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c26a6 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.545937:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8ef1d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.545951:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8ef1d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.545962:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8ef1d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776509.546028:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789776509.546033:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789776509.546079:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8ef1d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.546297:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678c00/0x26940258de8ef1ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c26a6 expref: 9 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.546328:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8ef1d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c26a6 expref: 8 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.546351:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c8682cbe900) 00010000:00010000:3.0:1789776509.546354:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789776509.546358:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8681678800, rc 0) 00000100:00100000:3.0:1789776509.546448:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+8:9677:x1876716462032000:12345-192.168.202.6@tcp:101:chown.0 Request processed in 592us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776509.546455:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 18 00000100:00100000:3.0:1789776509.549585:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776509.550650:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462032128 00000100:00100000:0.0:1789776509.550660:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462032128 00000100:00100000:0.0:1789776509.550719:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 19 00000100:00100000:0.0:1789776509.550730:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+8:9677:x1876716462032128:12345-192.168.202.6@tcp:101:chown.0 00010000:00010000:0.0:1789776509.550751:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776509.550770:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0000/0x26940258de8ef1d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c26ad expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.550836:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0800/0x26940258de8ef1df lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.550850:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0800/0x26940258de8ef1df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.550884:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0800/0x26940258de8ef1df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.550898:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1200/0x26940258de8ef1e6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.550905:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1200/0x26940258de8ef1e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.550912:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1200/0x26940258de8ef1e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.551271:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1800/0x26940258de8ef1ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.551281:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1800/0x26940258de8ef1ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.551288:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1800/0x26940258de8ef1ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776509.551381:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789776509.551385:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789776509.551408:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1800/0x26940258de8ef1ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.551429:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0800/0x26940258de8ef1df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.551437:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0800/0x26940258de8ef1df lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.551455:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0800/0x26940258de8ef1df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.551461:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86813a0800 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776509.551466:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0800/0x26940258de8ef1df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.551473:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0800/0x26940258de8ef1df lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.551485:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c8682cbe900) 00010000:00010000:0.0:1789776509.551488:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776509.551492:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0800/0x26940258de8ef1df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.551499:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0800/0x26940258de8ef1df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.551511:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1200/0x26940258de8ef1e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.551517:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1200/0x26940258de8ef1e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.551523:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1200/0x26940258de8ef1e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.551529:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86813a1200 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776509.551532:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1200/0x26940258de8ef1e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.551546:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1200/0x26940258de8ef1e6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.551554:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c86a08df700) 00010000:00010000:0.0:1789776509.551556:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776509.551559:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1200/0x26940258de8ef1e6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.551566:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1200/0x26940258de8ef1e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.551594:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0000/0x26940258de8ef1d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c26ad expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.551667:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1800/0x26940258de8ef1ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c26ad expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.551675:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c86a08df800) 00010000:00010000:0.0:1789776509.551678:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789776509.551680:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86813a1800, rc 0) 00000100:00100000:0.0:1789776509.551748:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+9:9677:x1876716462032128:12345-192.168.202.6@tcp:101:chown.0 Request processed in 1018us (2169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776509.551756:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 19 00000100:00100000:1.0:1789776509.555149:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776509.555263:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462032384 00000100:00100000:0.0:1789776509.555273:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462032384 00000100:00100000:0.0:1789776509.555327:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 20 00000100:00100000:0.0:1789776509.555338:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bff62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+9:9677:x1876716462032384:12345-192.168.202.6@tcp:36:chown.0 00010000:00010000:0.0:1789776509.555389:0:8177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776509.555436:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1800/0x26940258de8ef1ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c26ad expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.555455:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c86a08df800) 00010000:00010000:0.0:1789776509.555467:0:8177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789776509.555492:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0200/0x26940258de8ef1f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.555506:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0200/0x26940258de8ef1f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.555516:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0200/0x26940258de8ef1f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789776509.597966:0:8177:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b91f26a reply state 000000004e10858d transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0200/0x26940258de8ef1f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776509.597984:0:8177:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789776509.597999:0:8177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789776509.598129:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bff62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+10:9677:x1876716462032384:12345-192.168.202.6@tcp:36:chown.0 Request processed in 42786us (42983us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789776509.598138:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 20 00000001:00080000:3.0:1789776509.598427:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:2.0:1789776509.598508:0:3259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0200/0x26940258de8ef1f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.598517:0:3259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0200/0x26940258de8ef1f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.598525:0:3259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0200/0x26940258de8ef1f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.598535:0:3259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86813a0200 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776509.598540:0:3259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0200/0x26940258de8ef1f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.598563:0:3259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0200/0x26940258de8ef1f4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.598580:0:3259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c86a08df300) 00010000:00010000:2.0:1789776509.598583:0:3259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789776509.598587:0:3259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0200/0x26940258de8ef1f4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.598594:0:3259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0200/0x26940258de8ef1f4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776509.631819:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776509.631922:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462032512 00000100:00100000:2.0:1789776509.631933:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462032512 00000100:00100000:2.0:1789776509.631993:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 21 00000100:00100000:2.0:1789776509.632003:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bff63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+6:9678:x1876716462032512:12345-192.168.202.6@tcp:101:touch.500 00010000:00010000:2.0:1789776509.632025:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776509.632046:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6600/0x26940258de8ef1fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c26b4 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789776509.636018:0:5811:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3914us 00010000:00010000:3.0:1789776509.643565:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678c00/0x26940258de8ef202 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.643587:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678c00/0x26940258de8ef202 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.643599:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678c00/0x26940258de8ef202 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.643616:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8ef209 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.643623:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8ef209 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.643629:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8ef209 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.643950:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8ef210 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.643959:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8ef210 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.643974:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8ef210 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776509.643997:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789776509.644000:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789776509.644038:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8ef210 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.644051:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678c00/0x26940258de8ef202 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.644058:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678c00/0x26940258de8ef202 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.644359:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678c00/0x26940258de8ef202 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.644368:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681678c00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776509.644372:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678c00/0x26940258de8ef202 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.644380:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678c00/0x26940258de8ef202 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.644392:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c8682cbe900) 00010000:00010000:3.0:1789776509.644396:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776509.644400:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678c00/0x26940258de8ef202 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.644407:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678c00/0x26940258de8ef202 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.644444:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8ef209 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.644451:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8ef209 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.644457:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8ef209 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.644463:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681679200 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776509.644466:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8ef209 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.644472:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8ef209 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.644480:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c8682cbe400) 00010000:00010000:3.0:1789776509.644483:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776509.644485:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8ef209 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.644490:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8ef209 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.644525:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6600/0x26940258de8ef1fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c26b4 expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.644540:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8ef210 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c26b4 expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.644558:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c8682cbea00) 00010000:00010000:3.0:1789776509.644560:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789776509.644563:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8681679000, rc 0) 00000100:00100000:3.0:1789776509.644647:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bff63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+7:9678:x1876716462032512:12345-192.168.202.6@tcp:101:touch.500 Request processed in 12644us (12839us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776509.644655:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 21 00000100:00100000:2.0:1789776509.648640:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776509.648753:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462032768 00000100:00100000:3.0:1789776509.648763:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462032768 00000100:00100000:3.0:1789776509.648829:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 22 00000100:00100000:3.0:1789776509.648839:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf34ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+7:9678:x1876716462032768:12345-192.168.202.6@tcp:101:touch.500 00010000:00010000:3.0:1789776509.648868:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776509.648887:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8ef217 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c26bb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.649395:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8ef21e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.649410:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8ef21e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.649430:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8ef21e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.649446:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef225 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.649452:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef225 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.649467:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef225 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789776509.650918:0:5813:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1789776509.652050:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef22c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.652184:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef22c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.652198:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef22c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.652408:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8ef21e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.652426:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8ef21e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.652434:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8ef21e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.652440:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681679c00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776509.652444:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8ef21e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.652452:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8ef21e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.652464:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c8682cbea00) 00010000:00010000:3.0:1789776509.652467:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776509.652482:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8ef21e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.652488:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8ef21e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789776509.652502:0:5813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a28972a0 reply state 0000000092eb7bc2 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef225 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776509.652512:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789776509.652545:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8ef217 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c26bb expref: 10 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.652559:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef22c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c26bb expref: 9 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.652567:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c8682cbe700) 00010000:00010000:3.0:1789776509.652570:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789776509.652572:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86829e1200, rc 0) 00000100:00100000:3.0:1789776509.652714:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf34ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+10:9678:x1876716462032768:12345-192.168.202.6@tcp:101:touch.500 Request processed in 3875us (4083us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789776509.652724:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 22 00010000:00010000:3.0:1789776509.655603:0:3260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef225 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.655622:0:3260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef225 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.655628:0:3260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef225 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.655652:0:3260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86829e0400 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776509.655656:0:3260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef225 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.655664:0:3260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef225 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.655679:0:3260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xa178ae45 (ffff9c8682cbe300) 00010000:00010000:3.0:1789776509.655681:0:3260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776509.655738:0:3260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef225 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.655745:0:3260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef225 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776509.656152:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776509.656245:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462033024 00000100:00100000:0.0:1789776509.656255:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462033024 00000100:00100000:0.0:1789776509.656307:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 23 00000100:00100000:0.0:1789776509.656329:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf34e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+9:9678:x1876716462033024:12345-192.168.202.6@tcp:36:touch.500 00010000:00010000:1.0:1789776509.656459:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776509.656479:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef22c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c26bb expref: 9 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776509.656494:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c8682cbe700) 00010000:00010000:1.0:1789776509.656501:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789776509.656544:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef23a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776509.656558:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef23a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776509.656568:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef23a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789776509.656698:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009dfa0f96 reply state 000000007b0ea5cf transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef23a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776509.656707:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789776509.656845:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf34e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+10:9678:x1876716462033024:12345-192.168.202.6@tcp:36:touch.500 Request processed in 528us (697us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789776509.656853:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 23 00010000:00010000:2.0:1789776509.659561:0:3259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef23a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.659578:0:3259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef23a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.659586:0:3259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef23a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.659713:0:3259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5cb600 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776509.659718:0:3259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef23a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.659726:0:3259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef23a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.659743:0:3259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c8683789100) 00010000:00010000:2.0:1789776509.659746:0:3259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776509.659751:0:3259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef23a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.659756:0:3259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef23a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776509.661404:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776509.661488:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462033152 00000100:00100000:0.0:1789776509.661499:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462033152 00000100:00100000:0.0:1789776509.661567:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 24 00000100:00100000:0.0:1789776509.661577:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf34d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+9:9678:x1876716462033152:12345-192.168.202.6@tcp:101:touch.500 00010000:00010000:0.0:1789776509.661613:0:8177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776509.661635:0:8177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0000/0x26940258de8ef241 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c26c2 expref: -99 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.661696:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0000/0x26940258de8ef241 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c26c2 expref: 10 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.661711:0:8177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0000/0x26940258de8ef241 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c26c2 expref: 10 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.661732:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c86a08df800) 00010000:00010000:0.0:1789776509.661735:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789776509.661740:0:8177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86813a0000, rc 0) 00000100:00100000:0.0:1789776509.661800:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf34d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+10:9678:x1876716462033152:12345-192.168.202.6@tcp:101:touch.500 Request processed in 226us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776509.661806:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 24 00000100:00100000:1.0:1789776509.664583:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776509.664634:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462033280 00000100:00100000:3.0:1789776509.664644:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462033280 00000100:00100000:3.0:1789776509.664687:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 16 00000100:00100000:3.0:1789776509.664694:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bff62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1876716462033280:12345-192.168.202.6@tcp:8:touch.500 00010000:00080000:3.0:1789776509.664724:0:6661:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 0795fb8a-e14a-4768-806c-f332ad101de7@192.168.202.6@tcp t0 exp 0000000000000000 cur 262 last 0 00000020:00000080:3.0:1789776509.664752:0:6661:0:(genops.c:1385:class_connect()) connect: client 0795fb8a-e14a-4768-806c-f332ad101de7, cookie 0x26940258de8ef248 00002000:00100000:3.0:1789776509.664764:0:6661:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0795fb8a-e14a-4768-806c-f332ad101de7/ffff9c86bf207000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789776509.664775:0:6661:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789776509.665017:0:6661:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789776509.665046:0:6661:0:(import.c:65:import_set_state_nolock()) ffff9c86bf202800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789776509.665303:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bff62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+6:2353:x1876716462033280:12345-192.168.202.6@tcp:8:touch.500 Request processed in 606us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776509.665328:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 16 00000100:00100000:0.0:1789776509.667441:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776509.667555:0:8384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462033408 00000100:00100000:1.0:1789776509.667577:0:8384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462033408 00000100:00080000:3.0:1789776509.667622:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789776509.667647:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 17 00000100:00100000:1.0:1789776509.667655:0:8384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0795fb8a-e14a-4768-806c-f332ad101de7+6:0:x1876716462033408:12345-192.168.202.6@tcp:2:touch.500 00000100:00100000:2.0:1789776509.710461:0:8384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0795fb8a-e14a-4768-806c-f332ad101de7+7:0:x1876716462033408:12345-192.168.202.6@tcp:2:touch.500 Request processed in 42794us (43016us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789776509.710475:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 17 00000001:00080000:1.0:1789776509.710549:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:1.0:1789776509.710561:0:6684:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0795fb8a-e14a-4768-806c-f332ad101de7 00000100:00100000:2.0:1789776509.714582:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776509.714683:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462033664 00000100:00100000:1.0:1789776509.714693:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462033664 00000100:00100000:1.0:1789776509.714753:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 2 00000100:00100000:1.0:1789776509.714764:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf34d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+10:9678:x1876716462033664:12345-192.168.202.6@tcp:35:touch.500 00000100:00100000:1.0:1789776509.716259:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf34d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+11:9678:x1876716462033664:12345-192.168.202.6@tcp:35:touch.500 Request processed in 1490us (1681us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789776509.716270:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 2 00000100:00100000:0.0:1789776509.737443:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776509.737575:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462033792 00000100:00100000:3.0:1789776509.737586:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462033792 00000100:00100000:3.0:1789776509.737647:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 25 00000100:00100000:3.0:1789776509.737657:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+11:9679:x1876716462033792:12345-192.168.202.6@tcp:101:rm.0 00010000:00010000:3.0:1789776509.737682:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776509.737702:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef24f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c26c9 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.737764:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1a00/0x26940258de8ef256 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.737778:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1a00/0x26940258de8ef256 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.737789:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1a00/0x26940258de8ef256 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776509.737823:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789776509.737827:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789776509.737930:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1a00/0x26940258de8ef256 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.737958:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef24f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c26c9 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.737975:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1a00/0x26940258de8ef256 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c26c9 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.738006:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c8682cbea00) 00010000:00010000:3.0:1789776509.738009:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789776509.738012:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86829e1a00, rc 0) 00000100:00100000:3.0:1789776509.738811:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+12:9679:x1876716462033792:12345-192.168.202.6@tcp:101:rm.0 Request processed in 414us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776509.738822:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 25 00000100:00100000:0.0:1789776509.742846:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776509.743048:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462034048 00000100:00100000:3.0:1789776509.743058:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462034048 00000100:00100000:3.0:1789776509.743461:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 26 00000100:00100000:3.0:1789776509.743474:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+12:9679:x1876716462034048:12345-192.168.202.6@tcp:101:rm.0 00010000:00010000:3.0:1789776509.743496:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776509.743517:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef25d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c26d0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776509.743609:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789776509.743762:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef25d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c26d0 expref: 14 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.743777:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c8682cbe900) 00010000:00010000:3.0:1789776509.743780:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789776509.743786:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef25d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c26d0 expref: 14 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.743800:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86829e0a00, rc 0) 00000100:00100000:3.0:1789776509.743966:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+13:9679:x1876716462034048:12345-192.168.202.6@tcp:101:rm.0 Request processed in 495us (1129us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1789776509.743984:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 26 00000100:00100000:2.0:1789776509.748144:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776509.748210:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462034176 00000100:00100000:1.0:1789776509.748254:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462034176 00000100:00100000:1.0:1789776509.748308:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 3 00000100:00100000:1.0:1789776509.748446:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf34f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+13:9679:x1876716462034176:12345-192.168.202.6@tcp:37:rm.0 00000100:00100000:2.0:1789776509.753258:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf34f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+13:9679:x1876716462034176:12345-192.168.202.6@tcp:37:rm.0 Request processed in 4896us (5077us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776509.753272:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 3 00000100:00100000:0.0:1789776509.756696:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776509.756778:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462034432 00000100:00100000:2.0:1789776509.756787:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462034432 00000100:00100000:2.0:1789776509.756841:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4 00000100:00100000:2.0:1789776509.756851:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a0687c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+13:9679:x1876716462034432:12345-192.168.202.6@tcp:35:rm.0 00000100:00100000:2.0:1789776509.757610:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a0687c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+14:9679:x1876716462034432:12345-192.168.202.6@tcp:35:rm.0 Request processed in 757us (922us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789776509.757619:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4 00000100:00100000:0.0:1789776509.761111:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776509.761276:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462034688 00000100:00100000:1.0:1789776509.761286:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462034688 00000100:00100000:1.0:1789776509.761348:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 27 00000100:00100000:1.0:1789776509.761359:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+14:9679:x1876716462034688:12345-192.168.202.6@tcp:101:rm.0 00010000:00010000:1.0:1789776509.761384:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776509.761404:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef26b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c26d7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776509.761576:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef272 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776509.761604:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef272 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776509.761612:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef272 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776509.761621:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789776509.761749:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef26b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c26d7 expref: 17 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776509.761763:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef272 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c26d7 expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776509.761769:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c8682cbea00) 00010000:00010000:1.0:1789776509.761771:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789776509.761773:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86bf5caa00, rc 0) 00000100:00100000:1.0:1789776509.761828:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+16:9679:x1876716462034688:12345-192.168.202.6@tcp:101:rm.0 Request processed in 472us (729us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1789776509.761833:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 27 00000100:00100000:1.0:1789776509.765562:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776509.765677:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462034816 00000100:00100000:0.0:1789776509.765685:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462034816 00000100:00100000:0.0:1789776509.765742:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 28 00000100:00100000:0.0:1789776509.765752:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bff63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+16:9679:x1876716462034816:12345-192.168.202.6@tcp:41:rm.0 00000004:00000024:0.0:1789776509.765824:0:8177:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1789776509.765896:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bff63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+16:9679:x1876716462034816:12345-192.168.202.6@tcp:41:rm.0 Request processed in 145us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776509.765904:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 28 00000100:00100000:0.0:1789776509.769598:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776509.769715:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462034944 00000100:00100000:2.0:1789776509.769724:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462034944 00000100:00100000:2.0:1789776509.769781:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 29 00000100:00100000:2.0:1789776509.769792:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+16:9679:x1876716462034944:12345-192.168.202.6@tcp:101:rm.0 00010000:00010000:2.0:1789776509.769812:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776509.769833:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8ef280 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c26de expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.769960:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7e00/0x26940258de8ef287 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.769977:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7e00/0x26940258de8ef287 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.769988:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7e00/0x26940258de8ef287 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.770003:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8ef28e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.770009:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8ef28e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.770015:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8ef28e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.770376:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7000/0x26940258de8ef295 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.770398:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7000/0x26940258de8ef295 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.770405:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7000/0x26940258de8ef295 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776509.770443:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789776509.770447:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789776509.770466:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7000/0x26940258de8ef295 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.770477:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7000/0x26940258de8ef295 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.770484:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7e00/0x26940258de8ef287 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.770490:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7e00/0x26940258de8ef287 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.770497:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7e00/0x26940258de8ef287 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.770503:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc7e00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776509.770507:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7e00/0x26940258de8ef287 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.770514:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7e00/0x26940258de8ef287 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.770526:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c8682cbea00) 00010000:00010000:2.0:1789776509.770529:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776509.770539:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7e00/0x26940258de8ef287 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.770545:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7e00/0x26940258de8ef287 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.770559:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8ef28e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.770566:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8ef28e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.770572:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8ef28e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.770577:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc6c00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776509.770580:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8ef28e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.770586:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8ef28e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.770593:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xa178ae45 (ffff9c86881a7800) 00010000:00010000:2.0:1789776509.770596:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776509.770599:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8ef28e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.770605:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8ef28e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.770635:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8ef280 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c26de expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.770727:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7000/0x26940258de8ef295 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c26de expref: 17 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.770736:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c86a08df800) 00010000:00010000:2.0:1789776509.770739:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789776509.770741:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c868afc7000, rc 0) 00000100:00100000:2.0:1789776509.770808:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+17:9679:x1876716462034944:12345-192.168.202.6@tcp:101:rm.0 Request processed in 1017us (1217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776509.770816:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 29 00000100:00100000:1.0:1789776509.779414:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776509.784492:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462035200 00000100:00100000:3.0:1789776509.784508:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462035200 00000100:00100000:0.0:1789776509.784665:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 30 00000100:00100000:0.0:1789776509.784677:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bff60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+17:9679:x1876716462035200:12345-192.168.202.6@tcp:36:rm.0 00010000:00010000:0.0:1789776509.784727:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789776509.784750:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7000/0x26940258de8ef295 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c26de expref: 17 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.784767:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0000/0x26940258de8ef241 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c26c2 expref: 16 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.784776:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c86a08df800) 00010000:00010000:0.0:1789776509.784787:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1a00/0x26940258de8ef256 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c26c9 expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.784792:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c8682cbea00) 00010000:00010000:0.0:1789776509.784795:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789776509.784811:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1200/0x26940258de8ef29c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.784821:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1200/0x26940258de8ef29c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.784827:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1200/0x26940258de8ef29c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.784849:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1800/0x26940258de8ef2a3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.784853:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1800/0x26940258de8ef2a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.784867:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1800/0x26940258de8ef2a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.784958:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0200/0x26940258de8ef2aa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.784964:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0200/0x26940258de8ef2aa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.784968:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0200/0x26940258de8ef2aa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789776509.785684:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1789776509.785696:0:5813:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 262565478647ns, next at 263565476191ns, rc = 0 00010000:00010000:0.0:1789776509.785747:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0800/0x26940258de8ef2b1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.785756:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0800/0x26940258de8ef2b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.785764:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0800/0x26940258de8ef2b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.785776:0:5813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0800/0x26940258de8ef2b1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.785793:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0800/0x26940258de8ef2b1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.785799:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0800/0x26940258de8ef2b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.785820:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789776509.785839:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0200/0x26940258de8ef2aa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.785845:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0200/0x26940258de8ef2aa lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.785846:0:8421:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789776509.785851:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0200/0x26940258de8ef2aa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.785853:0:8421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0800/0x26940258de8ef2b1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.785857:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86813a0200 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776509.785859:0:8421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86813a0800 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:0.0:1789776509.785861:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0200/0x26940258de8ef2aa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.785862:0:8421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0800/0x26940258de8ef2b1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.785869:0:8421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0800/0x26940258de8ef2b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.785870:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0200/0x26940258de8ef2aa lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.785883:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c86a08dfd00) 00010000:00010000:0.0:1789776509.785886:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789776509.785888:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c86a08dfd00) 00010000:00010000:2.0:1789776509.785890:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789776509.785890:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0200/0x26940258de8ef2aa lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.785893:0:8421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0800/0x26940258de8ef2b1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.785896:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0200/0x26940258de8ef2aa lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.785899:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0800/0x26940258de8ef2b1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.785910:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776509.785910:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1200/0x26940258de8ef29c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.785916:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776509.785918:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776509.785921:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1200/0x26940258de8ef29c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.785927:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1200/0x26940258de8ef29c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.785932:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86813a1200 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776509.785935:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1200/0x26940258de8ef29c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.785941:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1200/0x26940258de8ef29c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.785950:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c8682cbea00) 00010000:00010000:0.0:1789776509.785952:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776509.785954:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1200/0x26940258de8ef29c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776509.785959:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1200/0x26940258de8ef29c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789776509.785970:0:5813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008fa37b79 reply state 00000000e226337e transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1800/0x26940258de8ef2a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776509.785978:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789776509.786058:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bff60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+16:9679:x1876716462035200:12345-192.168.202.6@tcp:36:rm.0 Request processed in 1382us (6653us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789776509.786067:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 30 00010000:00010000:3.0:1789776509.789635:0:3260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1800/0x26940258de8ef2a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.789651:0:3260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1800/0x26940258de8ef2a3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.789659:0:3260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1800/0x26940258de8ef2a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.789666:0:3260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86813a1800 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776509.789671:0:3260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1800/0x26940258de8ef2a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.789679:0:3260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1800/0x26940258de8ef2a3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.789694:0:3260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xa178ae45 (ffff9c86a08df700) 00010000:00010000:3.0:1789776509.789698:0:3260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776509.789702:0:3260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1800/0x26940258de8ef2a3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.789709:0:3260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1800/0x26940258de8ef2a3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776509.794959:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776509.795521:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462035456 00000100:00100000:2.0:1789776509.795531:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462035456 00000100:00100000:2.0:1789776509.795624:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5 00000100:00100000:2.0:1789776509.795635:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bff62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+15:9679:x1876716462035456:12345-192.168.202.6@tcp:35:rm.0 00000100:00100000:2.0:1789776509.795875:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bff62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+16:9679:x1876716462035456:12345-192.168.202.6@tcp:35:rm.0 Request processed in 241us (925us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789776509.795883:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5 00000100:00100000:1.0:1789776509.798177:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776509.798521:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462035712 00000100:00100000:3.0:1789776509.798530:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462035712 00000100:00100000:3.0:1789776509.798615:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 31 00000100:00100000:3.0:1789776509.798625:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9de6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+16:9679:x1876716462035712:12345-192.168.202.6@tcp:36:rm.0 00010000:00010000:3.0:1789776509.798683:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789776509.798711:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef272 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c26d7 expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.798731:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8ef210 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c26b4 expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.798742:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c8682cbea00) 00010000:00010000:3.0:1789776509.798758:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8ef1d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c26a6 expref: 14 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.798767:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c8682cbe900) 00010000:00010000:3.0:1789776509.798773:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789776509.798795:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef2b8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.798807:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef2b8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.798817:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef2b8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.798829:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef2bf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.798836:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef2bf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.798842:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef2bf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.799402:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1800/0x26940258de8ef2c6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.799414:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1800/0x26940258de8ef2c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.799432:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1800/0x26940258de8ef2c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776509.800797:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789776509.800817:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1800/0x26940258de8ef2c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.800825:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1800/0x26940258de8ef2c6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.800832:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1800/0x26940258de8ef2c6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.800837:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86829e1800 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776509.800842:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1800/0x26940258de8ef2c6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.800850:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1800/0x26940258de8ef2c6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.801276:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c8682cbe700) 00010000:00010000:3.0:1789776509.801280:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789776509.801286:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1800/0x26940258de8ef2c6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.801309:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1800/0x26940258de8ef2c6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.801402:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef2b8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.801409:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef2b8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.801426:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef2b8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.801432:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86829e0a00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776509.801435:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef2b8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.801442:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef2b8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.801522:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c8682cbe300) 00010000:00010000:3.0:1789776509.801526:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776509.801530:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef2b8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776509.801537:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef2b8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789776509.801551:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a46dd271 reply state 000000008b52cd8c transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef2bf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776509.801559:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789776509.801709:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9de6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+15:9679:x1876716462035712:12345-192.168.202.6@tcp:36:rm.0 Request processed in 3082us (3536us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789776509.801718:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 31 00010000:00010000:2.0:1789776509.803949:0:3259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef2bf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.803965:0:3259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef2bf lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.803973:0:3259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef2bf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.803980:0:3259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86829e0400 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776509.803993:0:3259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef2bf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.804002:0:3259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef2bf lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.804018:0:3259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c8682cbe400) 00010000:00010000:2.0:1789776509.804020:0:3259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776509.804024:0:3259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef2bf lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776509.804031:0:3259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef2bf lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776509.844745:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776510.357270:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471505408:0@lo:400:kworker.0 00000100:00100000:2.0:1789776510.357341:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776510.357443:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789776510.357458:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf295500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9db43398-240e-4f78-8778-c11d527e09a1:3273:1876716471505024:0@lo:400:kworker.0 00000100:00100000:2.0:1789776510.357487:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776510.357506:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf294700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3273:1876716471505536:0@lo:400:kworker.0 00000100:00100000:2.0:1789776510.357537:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776510.358049:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471505408 00000100:00100000:3.0:1789776510.358057:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471505408 00000100:00100000:3.0:1789776510.358115:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789776510.358125:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf34d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471505408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776510.358184:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf34d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471505408:12345-0@lo:400:kworker.0 Request processed in 62us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776510.358191:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1789776510.358296:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bf297b80 x1876716471505408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776510.358310:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471505408:0@lo:400:kworker.0 00000100:00100000:0.0:1789776510.358497:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf295c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3276:1876716471505280:0@lo:400:kworker.0 00000100:00100000:0.0:1789776510.358532:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776510.358578:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789776510.358585:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf296680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876716471505152:0@lo:400:kworker.0 00000100:00100000:0.0:1789776510.358606:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776510.358635:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471505664:0@lo:400:kworker.0 00000100:00100000:0.0:1789776510.358656:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776510.358684:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471505664 00000100:00100000:2.0:1789776510.358688:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471505536 00000100:00100000:0.0:1789776510.358688:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471505664 00000100:00100000:2.0:1789776510.358691:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471505536 00000100:00100000:2.0:1789776510.358718:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471505280 00000100:00100000:2.0:1789776510.358720:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471505280 00000100:00100000:0.0:1789776510.358720:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789776510.358726:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471505664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776510.358746:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471505152 00000100:00100000:2.0:1789776510.358749:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471505152 00000100:00100000:2.0:1789776510.358761:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789776510.358762:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471505664:12345-0@lo:400:kworker.0 Request processed in 36us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776510.358767:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf34f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1876716471505536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776510.358768:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1789776510.358794:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bf297100 x1876716471505664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776510.358801:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf34f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1876716471505536:12345-0@lo:400:kworker.0 Request processed in 35us (1264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776510.358804:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471505664:0@lo:400:kworker.0 00000100:00100000:2.0:1789776510.358807:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789776510.358818:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789776510.358825:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876716471505280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776510.358858:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf295c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3276:1876716471505280:0@lo:400:kworker.0 00000100:00100000:2.0:1789776510.358862:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876716471505280:12345-0@lo:400:kworker.0 Request processed in 28us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776510.358877:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789776510.358888:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789776510.358894:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876716471505152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776510.358934:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876716471505152:12345-0@lo:400:kworker.0 Request processed in 41us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776510.359039:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471505024 00000100:00100000:1.0:1789776510.359043:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471505024 00000100:00100000:1.0:1789776510.359072:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1789776510.359079:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa590450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+19:3273:x1876716471505024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776510.359117:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa590450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+19:3273:x1876716471505024:12345-0@lo:400:kworker.0 Request processed in 39us (1629us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776510.359123:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1789776510.359127:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789776510.359152:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf295500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9db43398-240e-4f78-8778-c11d527e09a1:3273:1876716471505024:0@lo:400:kworker.0 00000100:00100000:2.0:1789776510.359163:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf294700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3273:1876716471505536:0@lo:400:kworker.0 00000100:00080000:3.0:1789776510.359565:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789776510.359572:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789776510.359746:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf296680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876716471505152:0@lo:400:kworker.0 00000100:00100000:2.0:1789776510.868734:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789776510.868756:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9de5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471505792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789776510.868828:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776510.868939:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471505792 00000100:00100000:3.0:1789776510.868947:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471505792 00000100:00100000:3.0:1789776510.869006:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789776510.869016:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af8c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471505792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789776510.869049:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789776510.869099:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af8c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471505792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776510.869106:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1789776510.869259:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86b9de5880 x1876716471505792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776526 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776510.869278:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9de5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471505792:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789776510.869397:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776511.893200:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776512.800136:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776512.800177:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776512.800258:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776512.800282:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462035840 00000100:00100000:1.0:1789776512.800288:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776512.800296:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462035840 00000100:00100000:1.0:1789776512.800316:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462035968 00000100:00100000:1.0:1789776512.800322:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462035968 00000100:00100000:3.0:1789776512.800364:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 247 00000100:00100000:1.0:1789776512.800375:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462036224 00000100:00100000:1.0:1789776512.800380:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462036224 00000100:00100000:3.0:1789776512.800388:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa592c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:2354:x1876716462035840:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1789776512.800422:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 101 00000100:00100000:1.0:1789776512.800432:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9de7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+14:2354:x1876716462035968:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1789776512.800488:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa592c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:2354:x1876716462035840:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 103us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776512.800513:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 247 00000100:00100000:0.0:1789776512.800514:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462036096 00000100:00100000:0.0:1789776512.800519:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462036096 00000100:00100000:0.0:1789776512.800564:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 57 00000100:00100000:0.0:1789776512.800573:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9de5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0795fb8a-e14a-4768-806c-f332ad101de7+5:2354:x1876716462036096:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1789776512.800865:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 102 00000100:00100000:2.0:1789776512.800876:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9de6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d27fff26-e747-430b-8151-cc0e7e6df617+5:2354:x1876716462036224:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1789776512.801283:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9de7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+14:2354:x1876716462035968:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 850us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776512.801292:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 101 00000100:00080000:1.0:1789776512.801350:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789776512.801356:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789776512.801529:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9de5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0795fb8a-e14a-4768-806c-f332ad101de7+5:2354:x1876716462036096:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 956us (1350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776512.801538:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 57 00000100:00100000:1.0:1789776512.803350:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9de6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d27fff26-e747-430b-8151-cc0e7e6df617+5:2354:x1876716462036224:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 2463us (3049us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776512.803402:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 102 00010000:00010000:1.0:1789776512.916444:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776513.940995:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789776514.160771:0:11591:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000004:00080000:3.0:1789776514.452613:0:6755:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 267232393354ns, next at 268232390727ns, rc = 0 00000100:00100000:2.0:1789776514.452881:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf296680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471505920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789776514.452958:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776514.453106:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471505920 00000100:00100000:3.0:1789776514.453114:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471505920 00000100:00100000:3.0:1789776514.453176:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789776514.453186:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af8ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471505920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789776514.453237:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789776514.453297:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af8ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471505920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776514.453304:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1789776514.453641:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bf296680 x1876716471505920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776530 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776514.453661:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf296680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471505920:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789776514.453743:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789776514.974201:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789776515.026809:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:0.0:1789776515.026827:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:0.0:1789776515.026892:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:0.0:1789776515.026902:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:0.0:1789776515.026921:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:2.0:1789776515.027354:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789776515.027392:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471506048:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789776515.027488:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776515.027718:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471506048 00000100:00100000:0.0:1789776515.027728:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471506048 00000100:00100000:0.0:1789776515.027804:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789776515.027817:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471506048:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789776515.027858:0:6659:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1789776515.027914:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aadd27e, atime: 0x6aadd27e, ctime: 0x6aadd27e, blocks: 0x1 00010000:00010000:0.0:1789776515.027924:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c41216c/0x26940258de8ef2cd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776515.027944:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=267s v=(0 0) 00010000:00010000:0.0:1789776515.027949:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789776515.027957:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c41216c/0x26940258de8ef2cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776515.027978:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c41216c/0x26940258de8ef2cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776515.027995:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c41216c/0x26940258de8ef2cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776515.028007:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c41216c/0x26940258de8ef2cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776515.028105:0:6659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789776515.028136:0:8419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776515.028146:0:8419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c41216c/0x26940258de8ef2cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776515.028156:0:8419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86813a0800 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:1.0:1789776515.028161:0:8419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c41216c/0x26940258de8ef2cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776515.028171:0:8419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c41216c/0x26940258de8ef2cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776515.028196:0:8419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c41216c/0x26940258de8ef2cd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776515.028203:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c41216c/0x26940258de8ef2cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776515.028241:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776515.028244:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776515.028245:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789776515.030887:0:3273:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c86babc2300/2, rc 0, transno 4294967300 00000100:00100000:2.0:1789776515.030918:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471506048:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789776515.031708:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3273:x1876716471506048:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3888us (4214us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789776515.031732:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000020:00000080:2.0:1789776515.308637:0:11641:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc34d2ae20 20000000:00000080:2.0:1789776515.308665:0:11641:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c86bfdaf400 uarg=0000000000000000 20000000:01000000:2.0:1789776515.308714:0:11641:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1789776515.308724:0:11641:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1789776515.308730:0:11641:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1789776515.310673:0:11642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1789776515.310907:0:11641:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1789776515.333397:0:11641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1789776515.333480:0:11641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1789776515.333671:0:11641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1789776515.333694:0:11641:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789776515.333721:0:11641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c86813a0c00/0x26940258de8ef2d4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776515.333745:0:11641:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c8681678a00/0x26940258de8ef176 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8ef16f expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776515.333754:0:11641:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c8681678000/0x26940258de8ef184 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8ef17d expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776515.333762:0:11641:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c8680031400/0x26940258de8ef192 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8ef18b expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776515.333774:0:11641:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c8680031600/0x26940258de8ef199 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2691 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776515.333782:0:11641:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c86813a1a00/0x26940258de8ef1a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2698 expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776515.333790:0:11641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c86813a0c00/0x26940258de8ef2d4 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776515.333906:0:11641:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c86813a1a00/0x26940258de8ef1a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2698 expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776515.333927:0:11641:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c86813a1a00/0x26940258de8ef1a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2698 expref: 12 pid: 5804 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776515.333954:0:11641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa657800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11641:1876716471506176:192.168.202.6@tcp:104: 00010000:00010000:0.0:1789776515.334332:0:11641:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c8680031600/0x26940258de8ef199 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2691 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776515.334343:0:11641:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c8680031600/0x26940258de8ef199 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2691 expref: 12 pid: 5806 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776515.334354:0:11641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa654000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11641:1876716471506304:192.168.202.6@tcp:104: 00010000:00010000:0.0:1789776515.334401:0:11641:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c8680031400/0x26940258de8ef192 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26940258de8ef18b expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776515.334410:0:11641:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c8680031400/0x26940258de8ef192 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26940258de8ef18b expref: 18 pid: 5804 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776515.334421:0:11641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa654380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11641:1876716471506432:0@lo:104: 00000100:00100000:0.0:1789776515.334470:0:11641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789776515.334546:0:11641:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c8681678000/0x26940258de8ef184 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26940258de8ef17d expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776515.334553:0:11641:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c8681678000/0x26940258de8ef184 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26940258de8ef17d expref: 18 pid: 5804 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776515.334563:0:11641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba376d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11641:1876716471506560:0@lo:104: 00000100:00100000:0.0:1789776515.334585:0:11641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789776515.334606:0:11641:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c8681678a00/0x26940258de8ef176 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26940258de8ef16f expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776515.334615:0:11641:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c8681678a00/0x26940258de8ef176 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26940258de8ef16f expref: 18 pid: 5805 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776515.334630:0:11641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba375500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11641:1876716471506688:0@lo:104: 00000100:00100000:0.0:1789776515.334655:0:11641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776515.334666:0:11641:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8683e66480 going to sleep for 11 seconds 00000100:00100000:3.0:1789776515.334972:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789776515.334988:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471506432 00000100:00100000:3.0:1789776515.334997:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471506432 00000100:00100000:3.0:1789776515.335074:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471506560 00000100:00100000:3.0:1789776515.335078:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471506560 00000100:00100000:3.0:1789776515.335089:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471506688 00000100:00100000:3.0:1789776515.335092:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471506688 00000100:00100000:3.0:1789776515.335107:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789776515.335118:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa655f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9db43398-240e-4f78-8778-c11d527e09a1+5:11641:x1876716471506432:12345-0@lo:104: 00010000:00010000:3.0:1789776515.335134:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c86bf5cba00/0x26940258de8ef18b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8ef192 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776515.335242:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789776515.335249:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa655f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9db43398-240e-4f78-8778-c11d527e09a1+5:11641:x1876716471506432:12345-0@lo:104: Request processed in 133us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776515.335258:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789776515.335281:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789776515.335299:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba374380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9db43398-240e-4f78-8778-c11d527e09a1+4:11641:x1876716471506560:12345-0@lo:104: 00010000:00010000:3.0:1789776515.335308:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c8680030200/0x26940258de8ef17d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8ef184 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776515.335350:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789776515.335355:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba374380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9db43398-240e-4f78-8778-c11d527e09a1+4:11641:x1876716471506560:12345-0@lo:104: Request processed in 58us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776515.335362:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789776515.335387:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789776515.335394:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba223c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9db43398-240e-4f78-8778-c11d527e09a1+3:11641:x1876716471506688:12345-0@lo:104: 00010000:00010000:3.0:1789776515.335402:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c868afc7200/0x26940258de8ef16f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8ef176 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776515.335439:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789776515.335443:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba223c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9db43398-240e-4f78-8778-c11d527e09a1+3:11641:x1876716471506688:12345-0@lo:104: Request processed in 51us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776515.335449:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1789776515.335517:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789776515.335525:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c86bf5cba00/0x26940258de8ef18b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8ef192 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776515.335533:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5cba00 already unused, calling callback (ffffffffc1da0c20) 10000000:00010000:3.0:1789776515.335538:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c86bf5cba00/0x26940258de8ef18b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x26940258de8ef192 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776515.335548:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c86bf5cba00/0x26940258de8ef18b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x26940258de8ef192 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789776515.335557:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c86bf5cba00/0x26940258de8ef18b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x26940258de8ef192 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776515.335570:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789776515.335611:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c86bf5cba00/0x26940258de8ef18b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8ef192 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776515.335618:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789776515.335644:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c86bf5cba00/0x26940258de8ef18b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8ef192 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776515.335652:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c86bf5cba00/0x26940258de8ef18b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8ef192 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776515.335664:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789776515.335668:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c8680030200/0x26940258de8ef17d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8ef184 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776515.335673:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8680030200 already unused, calling callback (ffffffffc1da0c20) 10000000:00010000:3.0:1789776515.335675:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c8680030200/0x26940258de8ef17d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x26940258de8ef184 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776515.335682:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c8680030200/0x26940258de8ef17d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x26940258de8ef184 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789776515.335687:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c8680030200/0x26940258de8ef17d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x26940258de8ef184 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776515.335693:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789776515.335705:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c8680030200/0x26940258de8ef17d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8ef184 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776515.335710:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789776515.335725:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c8680030200/0x26940258de8ef17d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8ef184 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776515.335732:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c8680030200/0x26940258de8ef17d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8ef184 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776515.335742:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789776515.335745:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c868afc7200/0x26940258de8ef16f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8ef176 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776515.335752:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc7200 already unused, calling callback (ffffffffc1da0c20) 10000000:00010000:3.0:1789776515.335755:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c868afc7200/0x26940258de8ef16f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26940258de8ef176 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776515.335761:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c868afc7200/0x26940258de8ef16f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26940258de8ef176 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789776515.335767:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c868afc7200/0x26940258de8ef16f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26940258de8ef176 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776515.335772:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789776515.335785:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c868afc7200/0x26940258de8ef16f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8ef176 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776515.335791:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789776515.335821:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c868afc7200/0x26940258de8ef16f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8ef176 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776515.335828:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c868afc7200/0x26940258de8ef16f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8ef176 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776515.335842:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776515.335850:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776515.335852:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776515.335860:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776515.335866:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776515.335881:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf294700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471506816:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789776515.335921:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776515.335960:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789776515.335965:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf295500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471506944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789776515.335986:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776515.336020:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf295c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9db43398-240e-4f78-8778-c11d527e09a1:3273:1876716471507072:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789776515.336048:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776515.336086:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471506816 00000100:00100000:3.0:1789776515.336092:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471506816 00010000:00010000:3.0:1789776515.336114:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c8680031400/0x26940258de8ef192 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8ef18b expref: 19 pid: 5804 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776515.336140:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471506944 00000100:00100000:3.0:1789776515.336143:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471506944 00010000:00010000:3.0:1789776515.336155:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c8681678000/0x26940258de8ef184 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8ef17d expref: 20 pid: 5804 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776515.336170:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471507072 00000100:00100000:3.0:1789776515.336174:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471507072 00010000:00010000:3.0:1789776515.336185:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c8681678a00/0x26940258de8ef176 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8ef16f expref: 21 pid: 5805 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776515.336207:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789776515.336256:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf297100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9db43398-240e-4f78-8778-c11d527e09a1+21:3275:x1876716471506816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789776515.336271:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776515.336284:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c8680031400/0x26940258de8ef192 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8ef18b expref: 21 pid: 5804 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776515.336295:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c8680031400/0x26940258de8ef192 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26940258de8ef18b expref: 21 pid: 5804 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776515.336318:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776515.336349:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf297100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9db43398-240e-4f78-8778-c11d527e09a1+21:3275:x1876716471506816:12345-0@lo:103:ldlm_bl.0 Request processed in 135us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776515.336356:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789776515.336385:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789776515.336392:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf297b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9db43398-240e-4f78-8778-c11d527e09a1+20:3275:x1876716471506944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789776515.336399:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776515.336403:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c8681678000/0x26940258de8ef184 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8ef17d expref: 20 pid: 5804 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776515.336412:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c8681678000/0x26940258de8ef184 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26940258de8ef17d expref: 20 pid: 5804 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776515.336422:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776515.336444:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf297b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9db43398-240e-4f78-8778-c11d527e09a1+20:3275:x1876716471506944:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776515.336450:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789776515.336463:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789776515.336470:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c869880e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9db43398-240e-4f78-8778-c11d527e09a1+19:3273:x1876716471507072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789776515.336477:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776515.336481:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c8681678a00/0x26940258de8ef176 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8ef16f expref: 19 pid: 5805 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776515.336500:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c8681678a00/0x26940258de8ef176 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26940258de8ef16f expref: 19 pid: 5805 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776515.336510:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776515.336536:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c869880e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9db43398-240e-4f78-8778-c11d527e09a1+19:3273:x1876716471507072:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776515.336543:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789776515.336613:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf295c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9db43398-240e-4f78-8778-c11d527e09a1:3273:1876716471507072:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789776515.336644:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf295500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471506944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789776515.336653:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf294700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471506816:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789776515.337144:0:11641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c8680031400/0x26940258de8ef192 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26940258de8ef18b expref: 18 pid: 5804 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776515.337161:0:11641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa654380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11641:1876716471506432:0@lo:104: 00010000:00010000:0.0:1789776515.337174:0:11641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c8681678000/0x26940258de8ef184 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26940258de8ef17d expref: 17 pid: 5804 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776515.337183:0:11641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba376d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11641:1876716471506560:0@lo:104: 00010000:00010000:0.0:1789776515.337194:0:11641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c8681678a00/0x26940258de8ef176 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26940258de8ef16f expref: 16 pid: 5805 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776515.337202:0:11641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba375500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11641:1876716471506688:0@lo:104: 00000100:00100000:2.0:1789776515.343051:0:11641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa657800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11641:1876716471506176:192.168.202.6@tcp:104: 00000100:00100000:2.0:1789776515.343081:0:11641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa654000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11641:1876716471506304:192.168.202.6@tcp:104: 00010000:00010000:2.0:1789776515.343128:0:11641:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c86813a0c00/0x26940258de8ef2d4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776515.355081:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776515.355276:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776515.355388:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462036352 00000100:00100000:3.0:1789776515.355406:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462036352 00010000:00010000:3.0:1789776515.355470:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c86813a1a00/0x26940258de8ef1a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2698 expref: 13 pid: 5804 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776515.355520:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462036480 00000100:00100000:3.0:1789776515.355523:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462036480 00010000:00010000:3.0:1789776515.355535:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c8680031600/0x26940258de8ef199 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2691 expref: 14 pid: 5806 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776515.355566:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 33 00000100:00100000:3.0:1789776515.355577:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba376680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+14:2357:x1876716462036352:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789776515.355596:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776515.355602:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c86813a1a00/0x26940258de8ef1a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2698 expref: 14 pid: 5804 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776515.355631:0:11143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 34 00010000:00010000:3.0:1789776515.355644:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c86813a1a00/0x26940258de8ef1a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2698 expref: 14 pid: 5804 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776515.355647:0:11143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba375c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+14:2357:x1876716462036480:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789776515.355663:0:11143:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776515.355671:0:11143:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c8680031600/0x26940258de8ef199 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2691 expref: 14 pid: 5806 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776515.355678:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c86813a1a00/0x26940258de8ef1a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2698 expref: 14 pid: 5804 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776515.355688:0:11143:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c8680031600/0x26940258de8ef199 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2691 expref: 14 pid: 5806 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776515.355704:0:11143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c8680031600/0x26940258de8ef199 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2691 expref: 13 pid: 5806 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776515.355709:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c86813a0c00/0x26940258de8ef2d4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776515.355720:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c86813a0c00/0x26940258de8ef2d4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776515.355923:0:11143:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776515.356013:0:11143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba375c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+12:2357:x1876716462036480:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 371us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776515.356033:0:11143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 34 00010000:00010000:3.0:1789776515.357230:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c86813a0c00/0x26940258de8ef2d4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776515.357247:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c86813a0c00/0x26940258de8ef2d4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776515.357254:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c86813a0c00/0x26940258de8ef2d4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776515.357261:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c86813a0c00/0x26940258de8ef2d4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776515.357267:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86813a0c00 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:3.0:1789776515.357272:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c86813a0c00/0x26940258de8ef2d4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776515.357280:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c86813a0c00/0x26940258de8ef2d4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776515.357322:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c86813a0c00/0x26940258de8ef2d4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776515.357336:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776515.357471:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba376680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+11:2357:x1876716462036352:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 1891us (2414us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776515.357483:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 33 00010000:00010000:2.0:1789776515.357554:0:11641:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c86813a0c00/0x26940258de8ef2d4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776515.357567:0:11641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c86813a0c00/0x26940258de8ef2d4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776515.357575:0:11641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c86813a0c00/0x26940258de8ef2d4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776515.482957:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9de5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3274:1876716471507200:0@lo:400:kworker.0 00000100:00100000:0.0:1789776515.483084:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776515.483281:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471507200 00000100:00100000:2.0:1789776515.483292:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471507200 00000100:00100000:2.0:1789776515.483368:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789776515.483390:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1876716471507200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776515.488811:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9de6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3273:1876716471507584:0@lo:400:kworker.0 00000100:00100000:1.0:1789776515.488926:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776515.489030:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789776515.489038:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9de4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471507712:0@lo:400:kworker.0 00000100:00100000:1.0:1789776515.489089:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776515.489133:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471507584 00000100:00100000:1.0:1789776515.489142:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471507584 00000100:00100000:1.0:1789776515.489212:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789776515.489259:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9de5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1876716471507584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776515.489327:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9de5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1876716471507584:12345-0@lo:400:kworker.0 Request processed in 74us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776515.489336:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789776515.489363:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471507712 00000100:00100000:1.0:1789776515.489366:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471507712 00000100:00100000:1.0:1789776515.489411:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789776515.489418:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9de6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471507712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776515.489450:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9de6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471507712:12345-0@lo:400:kworker.0 Request processed in 33us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776515.489457:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1789776515.489475:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789776515.489481:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789776515.489513:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86b9de4380 x1876716471507712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776515.489529:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9de4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471507712:0@lo:400:kworker.0 00000100:00100000:1.0:1789776515.489541:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9de6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3273:1876716471507584:0@lo:400:kworker.0 00000100:00100000:2.0:1789776515.490978:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1876716471507200:12345-0@lo:400:kworker.0 Request processed in 3660us (3965us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776515.490993:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789776515.495350:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9de5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3274:1876716471507200:0@lo:400:kworker.0 00000100:00100000:3.0:1789776515.495654:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9de7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3275:1876716471507328:0@lo:400:kworker.0 00000100:00100000:3.0:1789776515.496188:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776515.496594:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789776515.496605:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9de4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471507456:0@lo:400:kworker.0 00000100:00100000:3.0:1789776515.496641:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776515.497828:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471507328 00000100:00100000:1.0:1789776515.497844:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471507328 00000100:00100000:1.0:1789776515.497928:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789776515.497942:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf294700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1876716471507328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776515.499395:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf294700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1876716471507328:12345-0@lo:400:kworker.0 Request processed in 1447us (3199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776515.499410:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:1.0:1789776515.499458:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789776515.500311:0:8384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471507456 00000100:00100000:0.0:1789776515.500324:0:8384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471507456 00000100:00100000:0.0:1789776515.500403:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789776515.500415:0:8384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf295500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3275:x1876716471507456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776515.500506:0:8384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf295500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3275:x1876716471507456:12345-0@lo:400:kworker.0 Request processed in 94us (3864us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776515.500523:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789776515.503997:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9de7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3275:1876716471507328:0@lo:400:kworker.0 00000100:00100000:3.0:1789776515.504063:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9de4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471507456:0@lo:400:kworker.0 00000100:00100000:3.0:1789776515.988503:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9de6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471507840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789776515.988607:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789776515.988955:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776515.989030:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471507840 00000100:00100000:0.0:1789776515.989041:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471507840 00000100:00100000:0.0:1789776515.989118:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789776515.989131:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf295c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471507840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789776515.989178:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789776515.994205:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf295c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471507840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5061us (5582us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776515.994244:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1789776515.994658:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86b9de6d80 x1876716471507840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776531 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776515.994693:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9de6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471507840:0@lo:13:osp-pre-1-0.0 10000000:01000000:0.0:1789776516.500392:0:5808:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789776516.500405:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c86af31b000 from 7 10000000:01000000:0.0:1789776516.500412:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789776516.500484:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c86813a0200/0x26940258de8ef2db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776516.500500:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c86813a0200/0x26940258de8ef2db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776516.500514:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c86813a0200/0x26940258de8ef2db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776516.500617:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba374700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471507968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789776516.500799:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776516.500976:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8683e66cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789776516.505289:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471507968 00000100:00100000:2.0:1789776516.505314:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471507968 00000100:00100000:2.0:1789776516.505513:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1789776516.505528:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+16:5808:x1876716471507968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789776516.505562:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776516.505589:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c868afc6600/0x26940258de8ef2e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8ef2db expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776516.505651:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c868afc6600/0x26940258de8ef2e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8ef2db expref: 17 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776516.505663:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c868afc6600/0x26940258de8ef2e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8ef2db expref: 17 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776516.505675:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c868afc6600, rc 0) 00000100:00100000:2.0:1789776516.507097:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+17:5808:x1876716471507968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1561us (6285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776516.507111:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1789776516.507283:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba374700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471507968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789776516.507313:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c86813a0200/0x26940258de8ef2db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef2e2 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776516.507346:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c86813a0200/0x26940258de8ef2db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8ef2e2 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776516.507464:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba374700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471508096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789776516.507519:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776516.513411:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8683e66cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776516.516496:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471508096 00000100:00100000:3.0:1789776516.516524:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471508096 00000100:00100000:3.0:1789776516.516634:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1789776516.516647:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa592050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+17:5808:x1876716471508096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789776516.517652:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa592050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+17:5808:x1876716471508096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1001us (10126us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776516.517665:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1789776516.519347:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba374700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471508096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789776516.519447:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba374700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471508224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789776516.519542:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776516.523990:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8683e66cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776516.524395:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471508224 00000100:00100000:1.0:1789776516.524408:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471508224 00000100:00100000:1.0:1789776516.524485:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1789776516.524496:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+17:5808:x1876716471508224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789776516.524839:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+17:5808:x1876716471508224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 344us (5297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776516.524848:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1789776516.525209:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba374700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471508224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789776516.526536:0:11654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba374700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:11654:1876716471508352:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789776516.526640:0:11654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776516.526699:0:11654:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8683e66840 going to sleep for 11 seconds 00000100:00100000:1.0:1789776516.526868:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471508352 00000100:00100000:1.0:1789776516.526877:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471508352 00000100:00100000:1.0:1789776516.526919:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1789776516.526929:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa591850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+17:11654:x1876716471508352:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789776516.527251:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa591850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+17:11654:x1876716471508352:12345-0@lo:502:llog_process_th.0 Request processed in 286us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776516.527260:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1789776516.527522:0:11654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba374700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:11654:1876716471508352:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789776516.527569:0:11654:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789776516.527582:0:11654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776516.527586:0:11654:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789776516.527594:0:11654:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c86af31b000 00000020:00000080:0.0:1789776516.527597:0:11654:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789776516.527716:0:11654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba374700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:11654:1876716471508480:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789776516.527761:0:11654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776516.527785:0:11654:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8683e66840 going to sleep for 11 seconds 00000100:00100000:3.0:1789776516.527974:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471508480 00000100:00100000:3.0:1789776516.527989:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471508480 00000100:00100000:3.0:1789776516.528032:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1789776516.528041:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8691427450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+17:11654:x1876716471508480:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789776516.528264:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8691427450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+17:11654:x1876716471508480:12345-0@lo:502:llog_process_th.0 Request processed in 224us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776516.528272:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1789776516.534723:0:11654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba374700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:11654:1876716471508480:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789776516.534807:0:11654:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789776516.534819:0:11654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776516.534822:0:11654:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789776516.534827:0:11654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789776516.535069:0:5808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1789776516.535105:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789776516.535119:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c86813a0200/0x26940258de8ef2db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef2e2 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776516.535133:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c86813a0200/0x26940258de8ef2db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef2e2 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789776516.535148:0:5808:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789776516.535151:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c86903b8800 from 7 10000000:01000000:0.0:1789776516.535155:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789776516.535204:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c86813a1200/0x26940258de8ef2e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776516.535258:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c86813a1200/0x26940258de8ef2e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776516.535272:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c86813a1200/0x26940258de8ef2e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776516.535303:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba374700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471508608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789776516.535416:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776516.535466:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8683e66840 going to sleep for 11 seconds 00000100:00100000:2.0:1789776516.535913:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471508608 00000100:00100000:2.0:1789776516.535924:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471508608 00000100:00100000:2.0:1789776516.536005:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1789776516.536025:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8691424c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+17:5808:x1876716471508608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789776516.536043:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776516.536076:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c868afc7e00/0x26940258de8ef2f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8ef2e9 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776516.536107:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c868afc7e00/0x26940258de8ef2f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8ef2e9 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776516.536120:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c868afc7e00/0x26940258de8ef2f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8ef2e9 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776516.536130:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c868afc7e00, rc 0) 00000100:00100000:2.0:1789776516.536180:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8691424c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+18:5808:x1876716471508608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776516.536188:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1789776516.543518:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba374700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471508608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789776516.543576:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c86813a1200/0x26940258de8ef2e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef2f0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776516.543617:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c86813a1200/0x26940258de8ef2e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8ef2f0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776516.543750:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba374700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471508736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789776516.543844:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776516.543890:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8683e66840 going to sleep for 11 seconds 00000100:00100000:2.0:1789776516.547604:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471508736 00000100:00100000:2.0:1789776516.547629:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471508736 00000100:00100000:2.0:1789776516.547844:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1789776516.547859:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8691424050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+18:5808:x1876716471508736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776516.548374:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8691424050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+18:5808:x1876716471508736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 508us (4518us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776516.548384:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1789776516.548507:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba374700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471508736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789776516.548577:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba374700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471508864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789776516.548634:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776516.559830:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8683e66840 going to sleep for 11 seconds 00000100:00100000:3.0:1789776516.569093:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471508864 00000100:00100000:3.0:1789776516.569125:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471508864 00000100:00100000:3.0:1789776516.569251:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1789776516.569265:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86c2071450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+18:5808:x1876716471508864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789776516.569659:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86c2071450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+18:5808:x1876716471508864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 397us (21025us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776516.569669:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1789776516.569934:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba374700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471508864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789776516.570324:0:11657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf296300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:11657:1876716471508992:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789776516.576921:0:11657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776516.577023:0:11657:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8582d7cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789776516.577660:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471508992 00000100:00100000:0.0:1789776516.577674:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471508992 00000100:00100000:1.0:1789776516.578193:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1789776516.578208:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+18:11657:x1876716471508992:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789776516.578849:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+18:11657:x1876716471508992:12345-0@lo:502:llog_process_th.0 Request processed in 642us (5091us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776516.578859:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1789776516.579083:0:11657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf296300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:11657:1876716471508992:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789776516.579133:0:11657:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789776516.579147:0:11657:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776516.579150:0:11657:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789776516.579159:0:11657:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c86903b8800 00000020:00000080:2.0:1789776516.579162:0:11657:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789776516.579315:0:11657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:11657:1876716471509120:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789776516.579387:0:11657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776516.579421:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471509120 00000100:00100000:2.0:1789776516.579429:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471509120 00000100:00100000:2.0:1789776516.579465:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789776516.579474:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+18:11657:x1876716471509120:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789776516.579601:0:11657:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8691eed9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789776516.581019:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+18:11657:x1876716471509120:12345-0@lo:502:llog_process_th.0 Request processed in 1533us (1619us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776516.581035:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789776516.581649:0:11657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:11657:1876716471509120:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789776516.581696:0:11657:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789776516.581708:0:11657:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776516.581710:0:11657:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789776516.581717:0:11657:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789776516.582275:0:5808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1789776516.582300:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789776516.582313:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c86813a1200/0x26940258de8ef2e9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef2f0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776516.582345:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c86813a1200/0x26940258de8ef2e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef2f0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776516.582374:0:5808:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789776516.582377:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c86c01a7000 from 7 10000000:01000000:3.0:1789776516.582381:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789776516.582427:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c86829e1800/0x26940258de8ef2f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776516.582436:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c86829e1800/0x26940258de8ef2f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776516.582447:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c86829e1800/0x26940258de8ef2f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776516.582476:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf295880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471509248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789776516.582547:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776516.582587:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8582d7cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789776516.584100:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471509248 00000100:00100000:1.0:1789776516.584116:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471509248 00000100:00100000:1.0:1789776516.584201:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1789776516.584235:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+18:5808:x1876716471509248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789776516.584256:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776516.584278:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c86bf5cbe00/0x26940258de8ef2fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8ef2f7 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776516.584313:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c86bf5cbe00/0x26940258de8ef2fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8ef2f7 expref: 19 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776516.584328:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c86bf5cbe00/0x26940258de8ef2fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8ef2f7 expref: 19 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776516.584341:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86bf5cbe00, rc 0) 00000100:00100000:1.0:1789776516.584437:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+19:5808:x1876716471509248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 225us (1889us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776516.584445:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1789776516.584761:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf295880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471509248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789776516.584785:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c86829e1800/0x26940258de8ef2f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef2fe expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776516.584795:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c86829e1800/0x26940258de8ef2f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8ef2fe expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776516.584889:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf295880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471509376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789776516.584931:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776516.584984:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8582d7cc00 going to sleep for 11 seconds 00000040:00080000:3.0:1789776516.585604:0:11658:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789776516.586257:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471509376 00000100:00100000:1.0:1789776516.586267:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471509376 00000100:00100000:1.0:1789776516.586331:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789776516.586342:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+19:5808:x1876716471509376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789776516.589381:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+19:5808:x1876716471509376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3019us (4428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776516.589400:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789776516.589838:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf295880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471509376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776516.589921:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471509504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789776516.589989:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776516.590248:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471509504 00000100:00100000:3.0:1789776516.590257:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471509504 00000100:00100000:3.0:1789776516.590315:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1789776516.590327:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+19:5808:x1876716471509504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789776516.590576:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+19:5808:x1876716471509504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 250us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776516.590585:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789776516.591188:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8691eed300 going to sleep for 11 seconds 00000100:00100000:2.0:1789776516.591211:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9db43398-240e-4f78-8778-c11d527e09a1:5808:1876716471509504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789776516.591527:0:11659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:11659:1876716471509632:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789776516.591595:0:11659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776516.591619:0:11659:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8691eed9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776516.592258:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471509632 00000100:00100000:0.0:1789776516.592266:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471509632 00000100:00100000:0.0:1789776516.592325:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1789776516.592334:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+19:11659:x1876716471509632:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789776516.592625:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+19:11659:x1876716471509632:12345-0@lo:502:llog_process_th.0 Request processed in 291us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776516.592634:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789776516.593351:0:11659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:11659:1876716471509632:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789776516.593411:0:11659:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789776516.593426:0:11659:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776516.593430:0:11659:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789776516.593439:0:11659:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c86c01a7000 00000020:00000080:2.0:1789776516.593441:0:11659:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789776516.599314:0:11659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:11659:1876716471509760:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789776516.599457:0:11659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776516.599518:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471509760 00000100:00100000:0.0:1789776516.599528:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471509760 00000100:00100000:0.0:1789776516.599843:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789776516.599856:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+19:11659:x1876716471509760:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789776516.600416:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+19:11659:x1876716471509760:12345-0@lo:502:llog_process_th.0 Request processed in 559us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776516.600425:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789776516.600503:0:11659:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8683e66480 going to sleep for 11 seconds 00000100:00100000:0.0:1789776516.600534:0:11659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9db43398-240e-4f78-8778-c11d527e09a1:11659:1876716471509760:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789776516.600767:0:11659:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789776516.600778:0:11659:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776516.600781:0:11659:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789776516.600787:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789776516.605670:0:5808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1789776516.605744:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789776516.605761:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c86829e1800/0x26940258de8ef2f7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef2fe expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776516.605778:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c86829e1800/0x26940258de8ef2f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef2fe expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776517.013471:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776517.276586:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776517.276886:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462036608 00000100:00100000:2.0:1789776517.276905:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462036608 00000100:00100000:2.0:1789776517.277243:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 263 00000100:00100000:2.0:1789776517.277258:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+11:5598:x1876716462036608:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789776517.277284:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776517.277310:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c868afc7200/0x26940258de8ef305 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c26e5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776517.277349:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c868afc7200/0x26940258de8ef305 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c26e5 expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776517.277393:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c868afc7200/0x26940258de8ef305 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c26e5 expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776517.277410:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c868afc7200, rc 0) 00000100:00100000:2.0:1789776517.277494:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+12:5598:x1876716462036608:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 240us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776517.277502:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 263 00000100:00100000:0.0:1789776517.290530:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776517.290840:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462036736 00000100:00100000:2.0:1789776517.290855:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462036736 00000100:00100000:2.0:1789776517.290966:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 264 00000100:00100000:2.0:1789776517.290985:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+12:5598:x1876716462036736:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776517.291629:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+12:5598:x1876716462036736:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 653us (1115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776517.291639:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 264 00000100:00100000:1.0:1789776517.294287:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776517.294364:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462036864 00000100:00100000:2.0:1789776517.294382:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462036864 00000100:00100000:2.0:1789776517.294460:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 265 00000100:00100000:2.0:1789776517.294472:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+12:5598:x1876716462036864:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789776517.294783:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+12:5598:x1876716462036864:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 Request processed in 312us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776517.294792:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 265 00000100:00100000:1.0:1789776517.304692:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776517.306152:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462036992 00000100:00100000:2.0:1789776517.306172:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462036992 00000100:00100000:2.0:1789776517.306325:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 266 00000100:00100000:2.0:1789776517.306340:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+12:9949:x1876716462036992:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789776517.306733:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+12:9949:x1876716462036992:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 394us (2323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776517.306741:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 266 00000100:00100000:0.0:1789776517.319650:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776517.319841:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462037120 00000100:00100000:3.0:1789776517.319859:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462037120 00000100:00100000:3.0:1789776517.319944:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 267 00000100:00100000:3.0:1789776517.319958:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+12:9949:x1876716462037120:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789776517.320668:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+12:9949:x1876716462037120:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 704us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776517.320680:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 267 00000100:00100000:1.0:1789776517.330547:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776517.331634:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462037248 00000100:00100000:0.0:1789776517.331653:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462037248 00000100:00100000:0.0:1789776517.331732:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 268 00000100:00100000:0.0:1789776517.331745:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+12:5598:x1876716462037248:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789776517.331774:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776517.331801:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c86813a0800/0x26940258de8ef30c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c26ec expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776517.333796:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c86813a0800/0x26940258de8ef30c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c26ec expref: 13 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776517.333991:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c86813a0800/0x26940258de8ef30c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c26ec expref: 13 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776517.334515:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86813a0800, rc 0) 00000100:00100000:0.0:1789776517.334681:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:5598:x1876716462037248:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 2936us (4147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776517.334713:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 268 00000100:00100000:1.0:1789776517.342375:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776517.342628:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462037376 00000100:00100000:2.0:1789776517.342642:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462037376 00000100:00100000:2.0:1789776517.342724:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 269 00000100:00100000:2.0:1789776517.342737:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:5598:x1876716462037376:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776517.343122:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:5598:x1876716462037376:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 386us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776517.343131:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 269 00000100:00100000:1.0:1789776517.347972:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776517.348103:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462037504 00000100:00100000:0.0:1789776517.348117:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462037504 00000100:00100000:0.0:1789776517.348193:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 270 00000100:00100000:0.0:1789776517.348206:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:5598:x1876716462037504:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789776517.348610:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:5598:x1876716462037504:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 Request processed in 405us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776517.348619:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 270 00000100:00100000:1.0:1789776517.369563:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776517.369945:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462037632 00000100:00100000:3.0:1789776517.369961:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462037632 00000100:00100000:3.0:1789776517.370050:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 271 00000100:00100000:3.0:1789776517.370064:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:9952:x1876716462037632:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789776517.370475:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:9952:x1876716462037632:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 414us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776517.370486:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 271 00000100:00100000:1.0:1789776517.388867:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776517.393834:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462037760 00000100:00100000:2.0:1789776517.393859:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462037760 00000100:00100000:2.0:1789776517.393962:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 272 00000100:00100000:2.0:1789776517.393974:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:9952:x1876716462037760:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789776517.395266:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:9952:x1876716462037760:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 1283us (6406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776517.395280:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 272 00000040:00080000:3.0:1789776517.590549:0:11658:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789776517.918137:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776517.918195:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776517.918341:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462038016 00000100:00100000:2.0:1789776517.918364:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462038016 00000100:00100000:2.0:1789776517.918455:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462038272 00000100:00100000:2.0:1789776517.918458:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462038272 00000100:00100000:2.0:1789776517.918485:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 106 00000100:00100000:2.0:1789776517.918499:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9de4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+5:2355:x1876716462038016:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1789776517.918503:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 107 00000100:00100000:0.0:1789776517.918513:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9de5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d27fff26-e747-430b-8151-cc0e7e6df617+5:2355:x1876716462038272:12345-192.168.202.6@tcp:400:kworker.0 00000100:00080000:1.0:1789776517.918595:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789776517.918915:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9de5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d27fff26-e747-430b-8151-cc0e7e6df617+5:2355:x1876716462038272:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 403us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776517.918924:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 107 00000100:00100000:1.0:1789776517.920212:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776517.920296:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776517.920660:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462037888 00000100:00100000:0.0:1789776517.920672:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462037888 00000100:00100000:3.0:1789776517.921314:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462038144 00000100:00100000:3.0:1789776517.921323:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462038144 00000100:00100000:3.0:1789776517.921417:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 60 00000100:00100000:3.0:1789776517.921448:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9de7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+5:2355:x1876716462038144:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1789776517.921551:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9de7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+5:2355:x1876716462038144:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 106us (1253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776517.921559:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 60 00000100:00080000:3.0:1789776517.921590:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789776517.921914:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 273 00000100:00100000:0.0:1789776517.921935:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:2355:x1876716462037888:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1789776517.921976:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:2355:x1876716462037888:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 45us (1772us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776517.921983:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 273 00000100:00100000:2.0:1789776517.922185:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9de4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+5:2355:x1876716462038016:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 3687us (4062us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776517.922206:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 106 00010000:00010000:3.0:1789776518.039161:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776519.060460:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776519.577386:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789776519.577420:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471509888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789776519.577526:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776519.577697:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471509888 00000100:00100000:1.0:1789776519.577708:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471509888 00000100:00080000:3.0:1789776519.577758:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789776519.577801:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789776519.577815:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba374e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3275:x1876716471509888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789776519.577865:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789776519.577944:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba374e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3275:x1876716471509888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776519.577952:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789776519.578286:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471509888:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789776520.085263:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789776520.161021:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000100:00100000:2.0:1789776520.596594:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471510400:0@lo:400:kworker.0 00000100:00100000:2.0:1789776520.596686:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776520.596763:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789776520.596769:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3276:1876716471510272:0@lo:400:kworker.0 00000100:00100000:2.0:1789776520.596798:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776520.596945:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3274:1876716471510144:0@lo:400:kworker.0 00000100:00100000:0.0:1789776520.597001:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776520.597036:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471510656:0@lo:400:kworker.0 00000100:00100000:0.0:1789776520.597059:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776520.597081:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789776520.597086:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9db43398-240e-4f78-8778-c11d527e09a1:3274:1876716471510016:0@lo:400:kworker.0 00000100:00100000:0.0:1789776520.597136:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776520.597161:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3274:1876716471510528:0@lo:400:kworker.0 00000100:00100000:0.0:1789776520.597184:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776520.597263:0:8384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471510400 00000100:00100000:0.0:1789776520.597272:0:8384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471510400 00000100:00100000:0.0:1789776520.597342:0:8384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471510656 00000100:00100000:0.0:1789776520.597345:0:8384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471510656 00000100:00100000:0.0:1789776520.597385:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789776520.597394:0:8384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba3bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471510400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776520.597421:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471510272 00000100:00100000:0.0:1789776520.597452:0:8384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba3bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471510400:12345-0@lo:400:kworker.0 Request processed in 58us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776520.597455:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471510272 00000100:00100000:0.0:1789776520.597462:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789776520.597484:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789776520.597492:0:8384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba377480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471510656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776520.597500:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471510144 00000100:00100000:1.0:1789776520.597506:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471510144 00000100:00100000:1.0:1789776520.597520:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471510528 00000100:00100000:1.0:1789776520.597522:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471510528 00000100:00100000:1.0:1789776520.597535:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789776520.597542:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba3bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876716471510272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776520.597685:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789776520.597695:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba375180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1876716471510144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776520.597774:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471510016 00000100:00100000:3.0:1789776520.597779:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471510016 00000100:00100000:3.0:1789776520.597815:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1789776520.597823:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+19:3274:x1876716471510016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776520.599358:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba3bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876716471510272:12345-0@lo:400:kworker.0 Request processed in 1807us (2550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776520.599386:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789776520.599413:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789776520.599421:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba374a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1876716471510528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776520.599987:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba374a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1876716471510528:12345-0@lo:400:kworker.0 Request processed in 566us (2800us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776520.599992:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789776520.600051:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3274:1876716471510528:0@lo:400:kworker.0 00000100:00080000:1.0:1789776520.600087:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789776520.600091:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789776520.600119:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3276:1876716471510272:0@lo:400:kworker.0 00000100:00100000:1.0:1789776520.600127:0:3276:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1789776520.600131:0:3276:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c86babc2300, transno 4294967300 00000100:00100000:1.0:1789776520.600139:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471510400:0@lo:400:kworker.0 00000100:00100000:0.0:1789776520.606498:0:8384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba377480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471510656:12345-0@lo:400:kworker.0 Request processed in 8995us (9425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776520.606515:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:1.0:1789776520.606883:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86ba3bdc00 x1876716471510656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776520.606901:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471510656:0@lo:400:kworker.0 00000100:00100000:2.0:1789776520.607213:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba375180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1876716471510144:12345-0@lo:400:kworker.0 Request processed in 9518us (10209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776520.607249:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789776520.607373:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3274:1876716471510144:0@lo:400:kworker.0 00000100:00100000:3.0:1789776520.607622:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+19:3274:x1876716471510016:12345-0@lo:400:kworker.0 Request processed in 9798us (10483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776520.607632:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1789776520.607645:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9db43398-240e-4f78-8778-c11d527e09a1:3274:1876716471510016:0@lo:400:kworker.0 00010000:00010000:1.0:1789776521.109460:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776521.109523:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789776521.109545:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9de4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471510784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789776521.109620:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776521.110248:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471510784 00000100:00100000:1.0:1789776521.110258:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471510784 00000100:00100000:1.0:1789776521.110319:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789776521.110338:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba3be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471510784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789776521.110395:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789776521.110466:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba3be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471510784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776521.110473:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1789776521.110619:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86b9de4700 x1876716471510784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776537 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776521.110638:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9de4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471510784:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789776522.132408:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776523.037159:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776523.037205:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776523.037258:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462038400 00000100:00100000:0.0:1789776523.037270:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462038400 00000100:00100000:1.0:1789776523.037275:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776523.037319:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776523.037343:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 275 00000100:00100000:1.0:1789776523.037350:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462038528 00000100:00100000:0.0:1789776523.037356:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:2357:x1876716462038400:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1789776523.037357:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462038528 00000100:00100000:1.0:1789776523.037399:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462038784 00000100:00100000:1.0:1789776523.037404:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462038784 00000100:00100000:1.0:1789776523.037429:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 111 00000100:00100000:1.0:1789776523.037438:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9de5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+5:2357:x1876716462038528:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1789776523.037453:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:2357:x1876716462038400:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 100us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776523.037461:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 275 00000100:00100000:1.0:1789776523.037489:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9de5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+5:2357:x1876716462038528:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 51us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776523.037497:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 111 00000100:00100000:1.0:1789776523.037512:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 112 00000100:00100000:1.0:1789776523.037519:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9de7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d27fff26-e747-430b-8151-cc0e7e6df617+5:2357:x1876716462038784:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1789776523.037549:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9de7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d27fff26-e747-430b-8151-cc0e7e6df617+5:2357:x1876716462038784:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 32us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776523.037555:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 112 00000100:00080000:1.0:1789776523.037574:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789776523.037707:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462038656 00000100:00100000:2.0:1789776523.037712:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462038656 00000100:00100000:2.0:1789776523.037770:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 63 00000100:00100000:2.0:1789776523.037778:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9de4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0795fb8a-e14a-4768-806c-f332ad101de7+5:2357:x1876716462038656:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1789776523.037815:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9de4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0795fb8a-e14a-4768-806c-f332ad101de7+5:2357:x1876716462038656:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 39us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776523.037821:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 63 00000100:00080000:1.0:1789776523.037959:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789776523.156552:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776524.181817:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776524.693946:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471510912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789776524.694032:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776524.694205:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471510912 00000100:00100000:2.0:1789776524.694249:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471510912 00000100:00100000:2.0:1789776524.694322:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789776524.694334:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9de4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471510912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789776524.694374:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789776524.694425:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9de4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471510912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776524.694433:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789776524.694480:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471510912:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789776524.694884:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789776525.205596:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776525.717068:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9de4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9db43398-240e-4f78-8778-c11d527e09a1:3273:1876716471511040:0@lo:400:kworker.0 00000100:00100000:2.0:1789776525.717156:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776525.717257:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471511040 00000100:00100000:3.0:1789776525.717264:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471511040 00000100:00100000:3.0:1789776525.717360:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1789776525.717370:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+19:3273:x1876716471511040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776525.717952:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9de6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3274:1876716471511168:0@lo:400:kworker.0 00000100:00100000:0.0:1789776525.717987:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776525.718043:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471511168 00000100:00100000:0.0:1789776525.718047:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471511168 00000100:00100000:0.0:1789776525.718070:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789776525.718075:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1876716471511168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776525.718103:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1876716471511168:12345-0@lo:400:kworker.0 Request processed in 28us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776525.718107:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789776525.718136:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9de6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3274:1876716471511168:0@lo:400:kworker.0 00000100:00100000:3.0:1789776525.719642:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+19:3273:x1876716471511040:12345-0@lo:400:kworker.0 Request processed in 2270us (2482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776525.719688:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9de6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471511680:0@lo:400:kworker.0 00000100:00100000:1.0:1789776525.719753:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776525.719790:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789776525.719797:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9de5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3274:1876716471511552:0@lo:400:kworker.0 00000100:00100000:1.0:1789776525.719820:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776525.719851:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471511680 00000100:00100000:1.0:1789776525.719857:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471511680 00000100:00100000:0.0:1789776525.719871:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9de4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3275:1876716471511296:0@lo:400:kworker.0 00000100:00100000:0.0:1789776525.719908:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776525.719912:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789776525.719923:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471511680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776525.719982:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471511680:12345-0@lo:400:kworker.0 Request processed in 61us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776525.719988:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789776525.720003:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:1.0:1789776525.720008:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789776525.720016:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9de7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471511424:0@lo:400:kworker.0 00010000:00080000:1.0:1789776525.720038:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86b9de6d80 x1876716471511680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776525.720050:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776525.720058:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9de6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471511680:0@lo:400:kworker.0 00000100:00100000:3.0:1789776525.720104:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1789776525.720106:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471511424 00000100:00100000:1.0:1789776525.720111:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471511424 00000100:00100000:1.0:1789776525.720142:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789776525.720151:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba377100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471511424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776525.720152:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471511552 00000100:00100000:3.0:1789776525.720158:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471511552 00000100:00100000:3.0:1789776525.720195:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471511296 00000100:00100000:1.0:1789776525.720201:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba377100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471511424:12345-0@lo:400:kworker.0 Request processed in 52us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776525.720210:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789776525.720212:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471511296 00000100:00100000:3.0:1789776525.720267:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789776525.720274:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789776525.720277:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1876716471511552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776525.720299:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba375880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1876716471511296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776525.720338:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1876716471511552:12345-0@lo:400:kworker.0 Request processed in 62us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776525.720348:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789776525.720349:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba375880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1876716471511296:12345-0@lo:400:kworker.0 Request processed in 63us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776525.720359:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:1.0:1789776525.720392:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789776525.720412:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9de5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3274:1876716471511552:0@lo:400:kworker.0 00000100:00100000:0.0:1789776525.720555:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9de7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471511424:0@lo:400:kworker.0 00000100:00100000:0.0:1789776525.720565:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9de4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3275:1876716471511296:0@lo:400:kworker.0 00000100:00100000:2.0:1789776525.725685:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9de4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9db43398-240e-4f78-8778-c11d527e09a1:3273:1876716471511040:0@lo:400:kworker.0 00000100:00100000:2.0:1789776526.230179:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789776526.230206:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471511808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789776526.230326:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776526.230424:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471511808 00000100:00100000:3.0:1789776526.230433:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471511808 00000100:00100000:3.0:1789776526.230488:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789776526.230498:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba3bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471511808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789776526.230534:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789776526.230591:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba3bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471511808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776526.230599:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1789776526.230753:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86ba3bf800 x1876716471511808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776542 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776526.230771:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471511808:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789776526.231177:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776527.252750:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789776527.828918:0:11658:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789776528.171479:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776528.171531:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776528.171556:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776528.171591:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776528.171623:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462039168 00000100:00100000:1.0:1789776528.171633:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462039168 00000100:00100000:2.0:1789776528.171796:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462038912 00000100:00100000:2.0:1789776528.171800:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462038912 00000100:00100000:2.0:1789776528.171835:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 277 00000100:00100000:2.0:1789776528.171860:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:2354:x1876716462038912:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1789776528.171970:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462039040 00000100:00100000:3.0:1789776528.171976:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462039040 00000100:00100000:3.0:1789776528.172007:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462039296 00000100:00100000:3.0:1789776528.172010:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462039296 00000100:00100000:3.0:1789776528.172034:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 116 00000100:00100000:3.0:1789776528.172041:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+5:2354:x1876716462039040:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1789776528.172082:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+5:2354:x1876716462039040:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 42us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776528.172089:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 116 00000100:00100000:3.0:1789776528.172118:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 117 00000100:00100000:3.0:1789776528.172125:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d27fff26-e747-430b-8151-cc0e7e6df617+5:2354:x1876716462039296:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1789776528.172147:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d27fff26-e747-430b-8151-cc0e7e6df617+5:2354:x1876716462039296:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 23us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776528.172167:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 117 00000100:00100000:2.0:1789776528.172175:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:2354:x1876716462038912:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 315us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776528.172193:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 277 00000100:00080000:2.0:1789776528.172265:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789776528.172280:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789776528.172300:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 66 00000100:00100000:2.0:1789776528.172308:0:8384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0795fb8a-e14a-4768-806c-f332ad101de7+5:2355:x1876716462039168:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1789776528.172347:0:8384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0795fb8a-e14a-4768-806c-f332ad101de7+5:2355:x1876716462039168:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 40us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776528.172354:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 66 00010000:00010000:3.0:1789776528.276476:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776529.300798:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776529.812538:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471511936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789776529.812614:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776529.813169:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471511936 00000100:00100000:2.0:1789776529.813178:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471511936 00000100:00080000:1.0:1789776529.813321:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789776529.813359:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789776529.813369:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471511936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789776529.813406:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789776529.813471:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471511936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776529.813478:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789776529.813550:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471511936:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789776530.324638:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776530.836637:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471512448:0@lo:400:kworker.0 00000100:00100000:2.0:1789776530.836708:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776530.836795:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789776530.836801:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3276:1876716471512320:0@lo:400:kworker.0 00000100:00100000:2.0:1789776530.836827:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776530.836859:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471512448 00000100:00100000:2.0:1789776530.836866:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471512448 00000100:00100000:2.0:1789776530.836913:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789776530.836922:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471512448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776530.836991:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471512448:12345-0@lo:400:kworker.0 Request processed in 69us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776530.836998:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789776530.837022:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471512320 00000100:00100000:2.0:1789776530.837025:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471512320 00000100:00100000:2.0:1789776530.837055:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789776530.837062:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876716471512320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776530.837093:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876716471512320:12345-0@lo:400:kworker.0 Request processed in 32us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776530.837100:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789776530.837137:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3276:1876716471512320:0@lo:400:kworker.0 00000100:00100000:2.0:1789776530.837148:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471512448:0@lo:400:kworker.0 00000100:00100000:1.0:1789776530.837429:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9db43398-240e-4f78-8778-c11d527e09a1:3273:1876716471512064:0@lo:400:kworker.0 00000100:00100000:1.0:1789776530.837465:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776530.837497:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3273:1876716471512576:0@lo:400:kworker.0 00000100:00100000:1.0:1789776530.837520:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776530.837539:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789776530.837544:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3273:1876716471512192:0@lo:400:kworker.0 00000100:00100000:1.0:1789776530.837562:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776530.837587:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c8582a70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471512704:0@lo:400:kworker.0 00000100:00100000:1.0:1789776530.837607:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776530.837628:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471512704 00000100:00100000:1.0:1789776530.837632:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471512704 00000100:00100000:1.0:1789776530.837658:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789776530.837664:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9de7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471512704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776530.837695:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9de7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471512704:12345-0@lo:400:kworker.0 Request processed in 31us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776530.837701:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789776530.837716:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471512576 00000100:00100000:1.0:1789776530.837719:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471512576 00000100:00100000:1.0:1789776530.837737:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471512192 00000100:00100000:1.0:1789776530.837740:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471512192 00000100:00100000:1.0:1789776530.837750:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789776530.837755:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9de4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1876716471512576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776530.837780:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9de4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1876716471512576:12345-0@lo:400:kworker.0 Request processed in 25us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776530.837800:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789776530.837811:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789776530.837816:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9de4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1876716471512192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776530.837841:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9de4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1876716471512192:12345-0@lo:400:kworker.0 Request processed in 25us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776530.837846:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:1.0:1789776530.837859:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789776530.837864:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789776530.837880:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3273:1876716471512192:0@lo:400:kworker.0 00010000:00080000:1.0:1789776530.837891:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c8582a70700 x1876716471512704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776530.837908:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c8582a70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471512704:0@lo:400:kworker.0 00000100:00100000:1.0:1789776530.837920:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3273:1876716471512576:0@lo:400:kworker.0 00000100:00100000:2.0:1789776530.838175:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471512064 00000100:00100000:2.0:1789776530.838297:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471512064 00000100:00100000:2.0:1789776530.838326:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1789776530.838332:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+19:3273:x1876716471512064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776530.838497:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+19:3273:x1876716471512064:12345-0@lo:400:kworker.0 Request processed in 164us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776530.838504:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1789776530.843541:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9db43398-240e-4f78-8778-c11d527e09a1:3273:1876716471512064:0@lo:400:kworker.0 00000100:00100000:3.0:1789776531.348675:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789776531.348703:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c8582a70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471512832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789776531.348783:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776531.348816:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471512832 00000100:00100000:0.0:1789776531.348825:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471512832 00000100:00100000:0.0:1789776531.348913:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789776531.348923:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf297100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471512832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789776531.348961:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789776531.349025:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf297100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471512832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776531.349034:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1789776531.349091:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c8582a70380 x1876716471512832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776547 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776531.349111:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c8582a70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471512832:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789776531.352055:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776532.372524:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776533.282016:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776533.282091:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776533.282286:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462039552 00000100:00100000:0.0:1789776533.282296:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462039552 00000100:00100000:0.0:1789776533.282374:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 121 00000100:00100000:0.0:1789776533.282386:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9de5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+5:2354:x1876716462039552:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1789776533.282465:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9de5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+5:2354:x1876716462039552:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 81us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776533.282472:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 121 00000100:00080000:1.0:1789776533.282751:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789776533.282963:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462039424 00000100:00100000:2.0:1789776533.282970:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462039424 00000100:00100000:2.0:1789776533.283017:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 279 00000100:00100000:2.0:1789776533.283025:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:2354:x1876716462039424:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1789776533.283086:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:2354:x1876716462039424:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 61us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776533.283111:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 279 00000100:00100000:1.0:1789776533.291123:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776533.291197:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776533.291348:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462039808 00000100:00100000:3.0:1789776533.291357:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462039808 00000100:00100000:3.0:1789776533.291419:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 122 00000100:00100000:3.0:1789776533.291426:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86880cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d27fff26-e747-430b-8151-cc0e7e6df617+5:2355:x1876716462039808:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1789776533.291510:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86880cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d27fff26-e747-430b-8151-cc0e7e6df617+5:2355:x1876716462039808:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 83us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776533.291518:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 122 00000100:00080000:1.0:1789776533.291844:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789776533.292052:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462039680 00000100:00100000:2.0:1789776533.292057:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462039680 00000100:00100000:2.0:1789776533.292105:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 19 00000100:00100000:2.0:1789776533.292111:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9de6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0795fb8a-e14a-4768-806c-f332ad101de7+5:2353:x1876716462039680:12345-192.168.202.6@tcp:9:kworker.0 00000020:00000080:2.0:1789776533.292130:0:6659:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x26940258de8ef248 00000100:00080000:2.0:1789776533.292138:0:6659:0:(import.c:65:import_set_state_nolock()) ffff9c86bf202800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789776533.292177:0:6659:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00080000:1.0:1789776533.292489:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789776533.292835:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9de6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0795fb8a-e14a-4768-806c-f332ad101de7+2:2353:x1876716462039680:12345-192.168.202.6@tcp:9:kworker.0 Request processed in 722us (1723us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776533.292843:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 19 00010000:00010000:0.0:1789776533.293911:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776533.397562:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776534.420390:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776534.933967:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789776534.933994:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c8582a70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471512960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789776534.934069:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776534.934274:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471512960 00000100:00100000:3.0:1789776534.934282:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471512960 00000100:00100000:3.0:1789776534.934361:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789776534.934372:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba376a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471512960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789776534.934406:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789776534.934472:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba376a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471512960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776534.934496:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1789776534.934890:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789776534.934973:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c8582a70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471512960:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789776535.450333:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789776535.561299:0:6684:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0795fb8a-e14a-4768-806c-f332ad101de7 00000020:00000080:3.0:1789776535.561311:0:6684:0:(genops.c:885:class_export_put()) final put ffff9c86bf207000/0795fb8a-e14a-4768-806c-f332ad101de7 00000020:00000080:1.0:1789776535.565335:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c86bf207000/0795fb8a-e14a-4768-806c-f332ad101de7 for lustre-OST0000 00000020:00000080:1.0:1789776535.575064:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c86bf202800 for lustre-OST0000 00000100:00100000:3.0:1789776535.957128:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3274:1876716471513216:0@lo:400:kworker.0 00000100:00100000:3.0:1789776535.957282:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776535.957361:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471513728:0@lo:400:kworker.0 00000100:00100000:1.0:1789776535.957380:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9db43398-240e-4f78-8778-c11d527e09a1:3273:1876716471513088:0@lo:400:kworker.0 00000100:00100000:3.0:1789776535.957398:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776535.957478:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3275:1876716471513344:0@lo:400:kworker.0 00000100:00100000:1.0:1789776535.957490:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776535.957545:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776535.957568:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3273:1876716471513600:0@lo:400:kworker.0 00000100:00100000:3.0:1789776535.957581:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789776535.957591:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf296680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471513472:0@lo:400:kworker.0 00000100:00100000:3.0:1789776535.957630:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776535.957685:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471513216 00000100:00100000:3.0:1789776535.957696:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471513216 00000100:00100000:3.0:1789776535.957756:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471513344 00000100:00100000:3.0:1789776535.957759:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471513344 00000100:00100000:3.0:1789776535.957796:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789776535.957805:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1876716471513216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776535.957884:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1876716471513216:12345-0@lo:400:kworker.0 Request processed in 79us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776535.957893:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789776535.957913:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789776535.957919:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa654000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1876716471513344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776535.957953:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa654000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1876716471513344:12345-0@lo:400:kworker.0 Request processed in 33us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776535.957985:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789776535.958008:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471513728 00000100:00100000:3.0:1789776535.958012:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471513728 00000100:00100000:3.0:1789776535.958039:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471513472 00000100:00100000:3.0:1789776535.958042:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471513472 00000100:00100000:3.0:1789776535.958071:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789776535.958078:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471513728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776535.958112:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471513728:12345-0@lo:400:kworker.0 Request processed in 35us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776535.958118:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789776535.958129:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789776535.958134:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa657800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471513472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776535.958159:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa657800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471513472:12345-0@lo:400:kworker.0 Request processed in 26us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776535.958164:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:3.0:1789776535.958193:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789776535.958199:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789776535.958311:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf296680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471513472:0@lo:400:kworker.0 00000100:00100000:3.0:1789776535.958323:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3275:1876716471513344:0@lo:400:kworker.0 00000100:00100000:3.0:1789776535.958358:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3274:1876716471513216:0@lo:400:kworker.0 00010000:00080000:3.0:1789776535.958373:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86ba6cb100 x1876716471513728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776535.958386:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471513728:0@lo:400:kworker.0 00000100:00100000:1.0:1789776535.960866:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776535.960972:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471513088 00000100:00100000:1.0:1789776535.960984:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471513088 00000100:00100000:2.0:1789776535.961129:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471513600 00000100:00100000:2.0:1789776535.961142:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471513600 00000100:00100000:2.0:1789776535.961276:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789776535.961289:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86880cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1876716471513600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776535.961391:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86880cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1876716471513600:12345-0@lo:400:kworker.0 Request processed in 104us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776535.961399:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789776535.961473:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3273:1876716471513600:0@lo:400:kworker.0 00000100:00100000:3.0:1789776535.961674:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1789776535.961707:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+19:3273:x1876716471513088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776535.961757:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+19:3273:x1876716471513088:12345-0@lo:400:kworker.0 Request processed in 53us (4278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776535.961764:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789776535.961993:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9db43398-240e-4f78-8778-c11d527e09a1:3273:1876716471513088:0@lo:400:kworker.0 00000100:00080000:1.0:1789776535.963177:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789776536.469063:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776536.469501:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c8582a70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471513856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789776536.469585:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776536.469689:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471513856 00000100:00100000:0.0:1789776536.469697:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471513856 00000100:00100000:0.0:1789776536.469747:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789776536.469756:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa654380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471513856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789776536.469792:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789776536.470036:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa654380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471513856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 280us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776536.470058:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1789776536.470124:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c8582a70000 x1876716471513856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776552 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776536.470142:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c8582a70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471513856:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1789776537.045930:0:11658:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789776537.497175:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776538.407774:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776538.407822:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776538.407859:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776538.407938:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462040064 00000100:00100000:3.0:1789776538.407948:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462040064 00000100:00100000:3.0:1789776538.408016:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462040192 00000100:00100000:3.0:1789776538.408020:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462040192 00000100:00100000:3.0:1789776538.408046:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 126 00000100:00100000:3.0:1789776538.408056:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86880ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+5:2356:x1876716462040064:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1789776538.408133:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86880ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+5:2356:x1876716462040064:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 77us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776538.408142:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 126 00000100:00100000:3.0:1789776538.408160:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 127 00000100:00100000:3.0:1789776538.408168:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86880cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d27fff26-e747-430b-8151-cc0e7e6df617+5:2356:x1876716462040192:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1789776538.408205:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86880cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d27fff26-e747-430b-8151-cc0e7e6df617+5:2356:x1876716462040192:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 38us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776538.408252:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 127 00000100:00100000:2.0:1789776538.408836:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462039936 00000100:00100000:2.0:1789776538.408842:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462039936 00000100:00080000:1.0:1789776538.408843:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789776538.408935:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 281 00000100:00100000:2.0:1789776538.408943:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:2356:x1876716462039936:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1789776538.408999:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:2356:x1876716462039936:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 57us (1176us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776538.409006:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 281 00010000:00010000:0.0:1789776538.516490:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776539.544862:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789776539.913842:0:11825:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 20:08:59 (1789776539) 00000100:00100000:2.0:1789776540.052880:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba375f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471513984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789776540.052964:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776540.053125:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471513984 00000100:00100000:0.0:1789776540.053134:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471513984 00000100:00080000:3.0:1789776540.053398:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789776540.054458:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789776540.054475:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471513984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789776540.054525:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789776540.054605:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471513984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (1641us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776540.054613:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789776540.054725:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba375f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471513984:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789776540.565209:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776541.076909:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa656680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9db43398-240e-4f78-8778-c11d527e09a1:3273:1876716471514112:0@lo:400:kworker.0 00000100:00100000:2.0:1789776541.077008:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776541.077171:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa654700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3274:1876716471514240:0@lo:400:kworker.0 00000100:00100000:0.0:1789776541.077210:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776541.077314:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471514240 00000100:00100000:0.0:1789776541.077321:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471514240 00000100:00100000:0.0:1789776541.077371:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789776541.077380:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1876716471514240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776541.077433:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1876716471514240:12345-0@lo:400:kworker.0 Request processed in 55us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776541.077439:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789776541.077483:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa654700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3274:1876716471514240:0@lo:400:kworker.0 00000100:00100000:1.0:1789776541.079502:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471514112 00000100:00100000:1.0:1789776541.079517:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471514112 00000100:00100000:1.0:1789776541.079585:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1789776541.079595:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+19:3273:x1876716471514112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776541.086392:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa654700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471514496:0@lo:400:kworker.0 00000100:00100000:3.0:1789776541.086649:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776541.086703:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789776541.086710:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86aa655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3276:1876716471514368:0@lo:400:kworker.0 00000100:00100000:1.0:1789776541.086951:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+19:3273:x1876716471514112:12345-0@lo:400:kworker.0 Request processed in 7355us (9940us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776541.086964:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1789776541.087045:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471514496 00000100:00100000:1.0:1789776541.087055:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471514496 00000100:00100000:1.0:1789776541.087099:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789776541.087107:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf297b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471514496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776541.087159:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf297b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471514496:12345-0@lo:400:kworker.0 Request processed in 53us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776541.087177:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789776541.087362:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776541.087405:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa654700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471514496:0@lo:400:kworker.0 00000100:00100000:0.0:1789776541.089067:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471514752:0@lo:400:kworker.0 00000100:00100000:0.0:1789776541.089157:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776541.089260:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789776541.089269:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3274:1876716471514624:0@lo:400:kworker.0 00000100:00100000:0.0:1789776541.089314:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776541.089354:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471514368 00000100:00100000:0.0:1789776541.089361:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471514368 00000100:00100000:0.0:1789776541.089413:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471514624 00000100:00100000:0.0:1789776541.089417:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471514624 00000100:00100000:0.0:1789776541.089438:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789776541.089458:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf295880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876716471514368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776541.089709:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf295880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876716471514368:12345-0@lo:400:kworker.0 Request processed in 251us (2345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776541.089718:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789776541.089749:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789776541.089756:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1876716471514624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776541.089856:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1876716471514624:12345-0@lo:400:kworker.0 Request processed in 99us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776541.089863:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:0.0:1789776541.089883:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789776541.089920:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3276:1876716471514368:0@lo:400:kworker.0 00000100:00100000:0.0:1789776541.089954:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3274:1876716471514624:0@lo:400:kworker.0 00000100:00100000:3.0:1789776541.091967:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471514752 00000100:00100000:3.0:1789776541.091984:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471514752 00000100:00100000:3.0:1789776541.092082:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789776541.092094:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba374000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471514752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776541.092189:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba374000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471514752:12345-0@lo:400:kworker.0 Request processed in 98us (3032us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776541.092197:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1789776541.093112:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789776541.093160:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86ba6cb100 x1876716471514752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789776557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776541.093186:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471514752:0@lo:400:kworker.0 00000100:00100000:2.0:1789776541.093382:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86aa656680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9db43398-240e-4f78-8778-c11d527e09a1:3273:1876716471514112:0@lo:400:kworker.0 00000100:00100000:3.0:1789776541.588786:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789776541.588816:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c8582a70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471514880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789776541.588899:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776541.589024:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471514880 00000100:00100000:2.0:1789776541.589034:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471514880 00000100:00100000:2.0:1789776541.589093:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789776541.589102:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf296300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471514880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789776541.589142:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789776541.589243:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf296300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471514880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 141us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776541.589250:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:1.0:1789776541.589529:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c8582a70700 x1876716471514880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776557 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776541.589549:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c8582a70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471514880:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789776541.589616:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776541.843638:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776541.846078:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462040320 00000100:00100000:0.0:1789776541.846097:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462040320 00000100:00080000:3.0:1789776541.846326:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789776541.846410:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 32 00000100:00100000:0.0:1789776541.846422:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86880cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+5:10221:x1876716462040320:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789776541.846458:0:8177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776541.847336:0:8177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1800/0x26940258de8ef313 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c26f3 expref: -99 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776541.847417:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0000/0x26940258de8ef31a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776541.847432:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0000/0x26940258de8ef31a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776541.847446:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0000/0x26940258de8ef31a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776541.848348:0:8177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789776541.848356:0:8177:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789776541.848415:0:8177:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0000/0x26940258de8ef31a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776541.848449:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1800/0x26940258de8ef313 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c26f3 expref: 7 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776541.848774:0:8177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0000/0x26940258de8ef31a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c26f3 expref: 6 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776541.848785:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c86a08df900) 00010000:00010000:0.0:1789776541.848788:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789776541.848792:0:8177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86813a0000, rc 0) 00000100:00100000:0.0:1789776541.848927:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86880cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+6:10221:x1876716462040320:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 2506us (5298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776541.848957:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 32 00000100:00100000:3.0:1789776541.865870:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776541.865960:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462040448 00000100:00100000:0.0:1789776541.865972:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462040448 00000100:00100000:0.0:1789776541.866041:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 33 00000100:00100000:0.0:1789776541.866052:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+6:10222:x1876716462040448:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789776541.866079:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776541.866103:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1800/0x26940258de8ef321 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c26fa expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776541.866206:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0c00/0x26940258de8ef328 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776541.866259:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0c00/0x26940258de8ef328 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776541.866272:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0c00/0x26940258de8ef328 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776541.866291:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1a00/0x26940258de8ef32f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776541.866298:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1a00/0x26940258de8ef32f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776541.866305:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1a00/0x26940258de8ef32f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776541.866793:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08600/0x26940258de8ef336 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776541.866807:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08600/0x26940258de8ef336 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776541.866812:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08600/0x26940258de8ef336 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776541.866835:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789776541.866838:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789776541.866851:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08600/0x26940258de8ef336 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776541.866858:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0c00/0x26940258de8ef328 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776541.866863:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0c00/0x26940258de8ef328 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776541.866867:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0c00/0x26940258de8ef328 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776541.866871:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86813a0c00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776541.866874:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0c00/0x26940258de8ef328 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776541.866878:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0c00/0x26940258de8ef328 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776541.866886:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c86a08df900) 00010000:00010000:0.0:1789776541.866888:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776541.866891:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0c00/0x26940258de8ef328 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776541.866901:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0c00/0x26940258de8ef328 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776541.866912:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1a00/0x26940258de8ef32f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776541.866915:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1a00/0x26940258de8ef32f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776541.866919:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1a00/0x26940258de8ef32f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776541.866922:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86813a1a00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776541.866923:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1a00/0x26940258de8ef32f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776541.866927:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1a00/0x26940258de8ef32f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776541.866931:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9c86a08dfe00) 00010000:00010000:0.0:1789776541.866932:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776541.866933:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1a00/0x26940258de8ef32f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776541.866936:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1a00/0x26940258de8ef32f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776541.866966:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a1800/0x26940258de8ef321 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c26fa expref: 8 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776541.866981:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08600/0x26940258de8ef336 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c26fa expref: 7 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776541.866995:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c86a08df500) 00010000:00010000:0.0:1789776541.866997:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789776541.867000:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86b9b08600, rc 0) 00000100:00100000:0.0:1789776541.867059:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+7:10222:x1876716462040448:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 1010us (1204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776541.867066:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 33 00000100:00100000:2.0:1789776541.876433:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776541.876747:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462040704 00000100:00100000:1.0:1789776541.876759:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462040704 00000100:00100000:1.0:1789776541.876842:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 34 00000100:00100000:1.0:1789776541.876852:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+7:10222:x1876716462040704:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789776541.876877:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776541.876898:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef33d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2701 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.877006:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca800/0x26940258de8ef344 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.877021:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca800/0x26940258de8ef344 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.877032:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca800/0x26940258de8ef344 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.877099:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef34b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.877106:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef34b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.877113:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef34b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.878149:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb800/0x26940258de8ef352 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.878177:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb800/0x26940258de8ef352 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.878186:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb800/0x26940258de8ef352 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776541.878199:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1789776541.880265:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca800/0x26940258de8ef344 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.880550:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca800/0x26940258de8ef344 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.880576:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca800/0x26940258de8ef344 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.880583:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5ca800 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776541.880589:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca800/0x26940258de8ef344 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.880598:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca800/0x26940258de8ef344 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.880615:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c86a08df500) 00010000:00010000:1.0:1789776541.880618:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776541.880623:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca800/0x26940258de8ef344 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.880630:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca800/0x26940258de8ef344 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.880643:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef34b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.880650:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef34b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.880655:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef34b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.880660:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5caa00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776541.880663:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef34b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.880679:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef34b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.880688:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9c8683789900) 00010000:00010000:1.0:1789776541.880690:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776541.880693:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef34b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.880799:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef34b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.882030:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef33d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2701 expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.882052:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb800/0x26940258de8ef352 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2701 expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776541.882061:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c8683789100) 00010000:00010000:1.0:1789776541.882063:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776541.882067:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86bf5cb800, rc 0) 00000100:00100000:1.0:1789776541.882146:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+9:10222:x1876716462040704:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 5295us (5728us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789776541.882166:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 34 00000100:00100000:1.0:1789776541.891836:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776541.892601:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462040832 00000100:00100000:3.0:1789776541.892613:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462040832 00000100:00100000:3.0:1789776541.892669:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 35 00000100:00100000:3.0:1789776541.892693:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86880cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+9:10222:x1876716462040832:12345-192.168.202.6@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789776541.893059:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86880cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+9:10222:x1876716462040832:12345-192.168.202.6@tcp:59:lhsmtool_posix.0 Request processed in 366us (1233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776541.893067:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 35 00000040:00080000:1.0:1789776542.167184:0:11658:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789776542.614023:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776543.516514:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776543.516574:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776543.516605:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776543.516687:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462040960 00000100:00100000:2.0:1789776543.516699:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462040960 00000100:00100000:2.0:1789776543.516761:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 283 00000100:00100000:2.0:1789776543.516772:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa595450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:2354:x1876716462040960:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1789776543.516856:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa595450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:2354:x1876716462040960:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 87us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776543.516865:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 283 00000100:00100000:1.0:1789776543.517036:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462041088 00000100:00100000:1.0:1789776543.517040:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462041088 00000100:00100000:1.0:1789776543.517085:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462041216 00000100:00100000:1.0:1789776543.517094:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462041216 00000100:00100000:1.0:1789776543.517116:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 131 00000100:00100000:1.0:1789776543.517123:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa656680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+9:2354:x1876716462041088:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1789776543.517174:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa656680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+9:2354:x1876716462041088:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 51us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776543.517182:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 131 00000100:00100000:1.0:1789776543.517194:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 132 00000100:00100000:1.0:1789776543.517200:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa655f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d27fff26-e747-430b-8151-cc0e7e6df617+5:2354:x1876716462041216:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1789776543.517295:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa655f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d27fff26-e747-430b-8151-cc0e7e6df617+5:2354:x1876716462041216:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 49us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776543.517301:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 132 00000100:00080000:2.0:1789776543.517572:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789776543.637756:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776544.333491:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776544.334333:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462041344 00000100:00100000:2.0:1789776544.334346:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462041344 00000100:00100000:2.0:1789776544.334414:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 36 00000100:00100000:2.0:1789776544.334426:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+9:10265:x1876716462041344:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1789776544.334450:0:8177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776544.334475:0:8177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7000/0x26940258de8ef360 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2708 expref: -99 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776544.334544:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8ef367 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776544.334559:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8ef367 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776544.334571:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8ef367 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776544.334584:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8ef36e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776544.334590:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8ef36e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776544.334595:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8ef36e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776544.334934:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8ef367 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776544.334943:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8ef367 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776544.334960:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8ef367 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776544.334965:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc6a00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776544.334970:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8ef367 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776544.334978:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8ef367 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776544.334990:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c86a08df900) 00010000:00010000:2.0:1789776544.334993:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776544.334998:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8ef367 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776544.335004:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8ef367 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776544.335016:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8ef36e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776544.335021:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8ef36e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776544.335027:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8ef36e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776544.335031:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc6c00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776544.335034:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8ef36e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776544.335049:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8ef36e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776544.335056:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9c86881a7800) 00010000:00010000:2.0:1789776544.335059:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776544.335061:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8ef36e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776544.335067:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8ef36e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776544.335104:0:8177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7000/0x26940258de8ef360 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2708 expref: 10 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776544.335114:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c86a08df900) 00010000:00010000:2.0:1789776544.335116:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776544.335120:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7000/0x26940258de8ef360 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2708 expref: 10 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776544.335129:0:8177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c868afc7000, rc 0) 00000100:00100000:2.0:1789776544.335309:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+9:10265:x1876716462041344:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 791us (1733us total) trans 0 rc 301/301 00000100:00100000:2.0:1789776544.335319:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 36 00000100:00100000:3.0:1789776544.340352:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776544.340841:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462041600 00000100:00100000:0.0:1789776544.340852:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462041600 00000100:00100000:0.0:1789776544.340918:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 37 00000100:00100000:0.0:1789776544.340929:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa654700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+9:10265:x1876716462041600:12345-192.168.202.6@tcp:36:lfs.0 00010000:00010000:0.0:1789776544.340981:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776544.341010:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86813a0000/0x26940258de8ef31a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c26f3 expref: 9 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776544.341031:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c86a08df900) 00010000:00010000:0.0:1789776544.341042:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789776544.342105:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09800/0x26940258de8ef375 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776544.342126:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09800/0x26940258de8ef375 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776544.342146:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09800/0x26940258de8ef375 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776544.342175:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8ef37c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776544.342182:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8ef37c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776544.342188:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8ef37c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776544.345095:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789776544.345117:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09800/0x26940258de8ef375 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776544.345127:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09800/0x26940258de8ef375 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776544.345146:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09800/0x26940258de8ef375 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776544.345153:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b09800 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776544.345157:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09800/0x26940258de8ef375 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776544.345165:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09800/0x26940258de8ef375 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776544.345184:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c86a08dfe00) 00010000:00010000:0.0:1789776544.345187:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776544.345193:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09800/0x26940258de8ef375 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776544.345213:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09800/0x26940258de8ef375 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789776544.345266:0:5813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000010fc49ad reply state 00000000f4f76f03 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8ef37c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776544.345276:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789776544.345407:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa654700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+10:10265:x1876716462041600:12345-192.168.202.6@tcp:36:lfs.0 Request processed in 4475us (5082us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789776544.345417:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 37 00010000:00010000:3.0:1789776544.351758:0:3260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8ef37c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.351784:0:3260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8ef37c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.351805:0:3260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8ef37c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.351812:0:3260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b09a00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776544.351818:0:3260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8ef37c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.351940:0:3260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8ef37c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.351961:0:3260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9c86a08df800) 00010000:00010000:3.0:1789776544.351964:0:3260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776544.351970:0:3260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8ef37c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.351994:0:3260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8ef37c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776544.503001:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776544.505401:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462041728 00000100:00100000:2.0:1789776544.505417:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462041728 00000100:00100000:2.0:1789776544.505501:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 38 00000100:00100000:2.0:1789776544.505513:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9defb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+9:10273:x1876716462041728:12345-192.168.202.6@tcp:101:lctl.0 00010000:00010000:2.0:1789776544.505539:0:8177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776544.505576:0:8177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8ef383 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c270f expref: -99 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776544.505667:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8ef38a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776544.505682:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8ef38a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776544.505695:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8ef38a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776544.505731:0:8177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789776544.505735:0:8177:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789776544.505774:0:8177:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8ef38a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776544.505813:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8ef383 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c270f expref: 11 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776544.507425:0:8177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8ef38a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c270f expref: 10 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776544.507442:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c86881a7800) 00010000:00010000:2.0:1789776544.507445:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789776544.507450:0:8177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c868afc6a00, rc 0) 00000100:00100000:2.0:1789776544.507536:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9defb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+10:10273:x1876716462041728:12345-192.168.202.6@tcp:101:lctl.0 Request processed in 2025us (4546us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776544.507545:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 38 00000100:00100000:0.0:1789776544.607934:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776544.608108:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462041856 00000100:00100000:3.0:1789776544.608122:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462041856 00000100:00100000:3.0:1789776544.608213:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 39 00000100:00100000:3.0:1789776544.608256:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+10:10279:x1876716462041856:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:3.0:1789776544.608276:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776544.608297:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef391 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2716 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.608370:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef398 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.608385:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef398 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.608397:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef398 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.608415:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef39f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.608422:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef39f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.608430:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef39f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.608559:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1a00/0x26940258de8ef3a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.608567:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1a00/0x26940258de8ef3a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.608574:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1a00/0x26940258de8ef3a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776544.608602:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1789776544.608606:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789776544.608645:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1a00/0x26940258de8ef3a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.608658:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef398 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.608665:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef398 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.608671:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef398 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.608677:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86829e0a00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776544.608681:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef398 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.608689:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef398 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.608701:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c86881a7800) 00010000:00010000:3.0:1789776544.608710:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776544.608716:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef398 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.608723:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef398 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.608740:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef39f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.608747:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef39f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.608754:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef39f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.608759:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86829e0400 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776544.608763:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef39f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.608769:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef39f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.608778:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9c8682cbe700) 00010000:00010000:3.0:1789776544.608780:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776544.609540:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef39f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.609553:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef39f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.609599:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef391 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2716 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.609634:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1a00/0x26940258de8ef3a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2716 expref: 11 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.609643:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c8682cbe900) 00010000:00010000:3.0:1789776544.609645:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789776544.609649:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86829e1a00, rc 0) 00000100:00100000:3.0:1789776544.609727:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+11:10279:x1876716462041856:12345-192.168.202.6@tcp:101:bash.0 Request processed in 1474us (1805us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776544.609736:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 39 00000100:00100000:1.0:1789776544.616029:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776544.616176:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462042112 00000100:00100000:3.0:1789776544.616186:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462042112 00000100:00100000:3.0:1789776544.616312:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 40 00000100:00100000:3.0:1789776544.616323:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86880cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+11:10279:x1876716462042112:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:3.0:1789776544.616347:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776544.616367:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef3ad lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c271d expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.616496:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef3b4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.616509:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef3b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.616517:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef3b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.616558:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef3bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.616576:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef3bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.616580:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef3bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789776544.617089:0:5812:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1789776544.617312:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef3c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.617324:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef3c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.617333:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef3c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.617368:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef3b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.617376:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef3b4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.617383:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef3b4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.617389:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86829e0400 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776544.617394:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef3b4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.617403:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef3b4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.617425:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c8682cbe900) 00010000:00010000:3.0:1789776544.617429:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776544.617433:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef3b4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.617439:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef3b4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789776544.617455:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f6d852d5 reply state 0000000082ab7d7b transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef3bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776544.617463:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789776544.617495:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef3ad lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c271d expref: 14 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.617510:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef3c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c271d expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.617517:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c8682cbe500) 00010000:00010000:3.0:1789776544.617520:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789776544.617522:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86829e1200, rc 0) 00000100:00100000:3.0:1789776544.617590:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86880cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+14:10279:x1876716462042112:12345-192.168.202.6@tcp:101:bash.0 Request processed in 1268us (1570us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789776544.617598:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 40 00000100:00100000:1.0:1789776544.626917:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00010000:2.0:1789776544.627123:0:3259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef3bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776544.627162:0:3259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef3bb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776544.627170:0:3259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef3bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776544.627177:0:3259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86829e0a00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776544.627182:0:3259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef3bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776544.627200:0:3259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef3bb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776544.627263:0:3259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c8682cbe700) 00010000:00010000:2.0:1789776544.627267:0:3259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776544.627272:0:3259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef3bb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776544.627278:0:3259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef3bb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776544.632968:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462042240 00000100:00100000:3.0:1789776544.632987:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462042240 00000100:00100000:3.0:1789776544.633056:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 20 00000100:00100000:3.0:1789776544.633065:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86880cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1876716462042240:12345-192.168.202.6@tcp:8:bash.0 00010000:00080000:3.0:1789776544.633112:0:6662:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 0795fb8a-e14a-4768-806c-f332ad101de7@192.168.202.6@tcp t0 exp 0000000000000000 cur 297 last 0 00000020:00000080:3.0:1789776544.633168:0:6662:0:(genops.c:1385:class_connect()) connect: client 0795fb8a-e14a-4768-806c-f332ad101de7, cookie 0x26940258de8ef3d0 00002000:00100000:3.0:1789776544.633183:0:6662:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0795fb8a-e14a-4768-806c-f332ad101de7/ffff9c8691410800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789776544.633245:0:6662:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789776544.633473:0:6662:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789776544.633507:0:6662:0:(import.c:65:import_set_state_nolock()) ffff9c8691410000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789776544.633584:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86880cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0795fb8a-e14a-4768-806c-f332ad101de7+6:2353:x1876716462042240:12345-192.168.202.6@tcp:8:bash.0 Request processed in 517us (6678us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776544.633593:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 20 00000100:00100000:0.0:1789776544.638294:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776544.638529:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462042368 00000100:00100000:3.0:1789776544.638542:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462042368 00000100:00100000:3.0:1789776544.638624:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 21 00000100:00100000:3.0:1789776544.638634:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba376d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+6:0:x1876716462042368:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:3.0:1789776544.638654:0:6661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776544.638680:0:6661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e32a78d/0x26940258de8ef3d7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2724 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789776544.638708:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789776544.638729:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=297s v=(0 0) 00010000:00010000:3.0:1789776544.638735:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789776544.638746:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e32a78d/0x26940258de8ef3d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2724 expref: 7 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.638768:0:6661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002e32a78d/0x26940258de8ef3d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2724 expref: 7 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.638818:0:6661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86829e0e00, rc 0) 00000100:00100000:3.0:1789776544.638892:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba376d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+7:0:x1876716462042368:12345-192.168.202.6@tcp:101:bash.0 Request processed in 258us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776544.638899:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 21 00000100:00080000:2.0:1789776544.639016:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789776544.650436:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776544.651032:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462042496 00000100:00100000:3.0:1789776544.651046:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462042496 00000100:00100000:3.0:1789776544.651117:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 22 00000100:00100000:3.0:1789776544.651129:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba374380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0795fb8a-e14a-4768-806c-f332ad101de7+7:10279:x1876716462042496:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:3.0:1789776544.651160:0:6662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776544.651184:0:6662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d02cd1be/0x26940258de8ef3de lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c272b expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.651965:0:6662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002e32a78d/0x26940258de8ef3d7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2724 expref: 8 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.651979:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789776544.651983:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789776544.651990:0:6662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d02cd1be/0x26940258de8ef3de lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c272b expref: 8 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.652030:0:6662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002e32a78d/0x26940258de8ef3d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2724 expref: 8 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.652048:0:6662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002e32a78d/0x26940258de8ef3d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2724 expref: 8 pid: 6661 timeout: 397 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776544.652085:0:6662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9dec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6662:1876716471515008:192.168.202.6@tcp:104: 00000100:00100000:3.0:1789776544.652214:0:6662:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8682de1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789776544.660351:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00010000:3.0:1789776544.660542:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776544.660606:0:11142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462042624 00000100:00100000:2.0:1789776544.660617:0:11142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462042624 00010000:00010000:2.0:1789776544.660664:0:11142:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002e32a78d/0x26940258de8ef3d7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2724 expref: 9 pid: 6661 timeout: 397 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776544.660718:0:11142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 35 00000100:00100000:2.0:1789776544.660728:0:11142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86880cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0795fb8a-e14a-4768-806c-f332ad101de7+9:2357:x1876716462042624:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789776544.660762:0:11142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776544.660800:0:11142:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002e32a78d/0x26940258de8ef3d7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2724 expref: 9 pid: 6661 timeout: 397 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776544.660818:0:11142:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002e32a78d/0x26940258de8ef3d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2724 expref: 9 pid: 6661 timeout: 397 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776544.660859:0:11142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776544.660864:0:11142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776544.660875:0:11142:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d02cd1be/0x26940258de8ef3de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c272b expref: 9 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776544.660885:0:11142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d02cd1be/0x26940258de8ef3de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c272b expref: 9 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776544.660930:0:11142:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d02cd1be/0x26940258de8ef3de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c272b expref: 9 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776544.660946:0:11142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c8582a70000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11142:1876716471515136:192.168.202.6@tcp:105: 00000100:00100000:2.0:1789776544.661043:0:11142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86903e6a80 going to sleep for 11 seconds 00010000:00010000:0.0:1789776544.663083:0:6662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e32a78d/0x26940258de8ef3d7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2724 expref: 9 pid: 6661 timeout: 397 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776544.663119:0:6662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9dec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6662:1876716471515008:192.168.202.6@tcp:104: 00010000:00010000:0.0:1789776544.663170:0:6662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d02cd1be/0x26940258de8ef3de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c272b expref: 8 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776544.663186:0:6662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86829e0400, rc 0) 00000100:00100000:0.0:1789776544.663454:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba374380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0795fb8a-e14a-4768-806c-f332ad101de7+8:10279:x1876716462042496:12345-192.168.202.6@tcp:101:bash.0 Request processed in 12326us (13029us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776544.663464:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 22 00000100:00100000:3.0:1789776544.666980:0:11142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c8582a70000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11142:1876716471515136:192.168.202.6@tcp:105: 00010000:00010000:3.0:1789776544.667010:0:11142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776544.667069:0:11142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86880cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0795fb8a-e14a-4768-806c-f332ad101de7+7:2357:x1876716462042624:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 6342us (6730us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776544.667081:0:11142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 35 00000100:00100000:3.0:1789776544.673407:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776544.673743:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462042880 00000100:00100000:1.0:1789776544.673755:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462042880 00000100:00100000:1.0:1789776544.673837:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 6 00000100:00100000:1.0:1789776544.673848:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+13:10279:x1876716462042880:12345-192.168.202.6@tcp:35:bash.0 00000100:00100000:1.0:1789776544.674437:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+14:10279:x1876716462042880:12345-192.168.202.6@tcp:35:bash.0 Request processed in 587us (1037us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1789776544.674446:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 6 00000100:00100000:1.0:1789776544.835542:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776544.835639:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462043136 00000100:00100000:3.0:1789776544.835651:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462043136 00000100:00100000:3.0:1789776544.835716:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 41 00000100:00100000:3.0:1789776544.835727:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86880cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+14:10289:x1876716462043136:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1789776544.835751:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776544.835772:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef3e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2732 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776544.835863:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789776544.835995:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef3e5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2732 expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.836009:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c86881a7800) 00010000:00010000:3.0:1789776544.836013:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789776544.836018:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef3e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2732 expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776544.836051:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86829e0a00, rc 0) 00000100:00100000:3.0:1789776544.836124:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86880cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+15:10289:x1876716462043136:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 399us (593us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1789776544.836164:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 41 00000100:00100000:0.0:1789776544.841770:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776544.841882:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462043392 00000100:00100000:1.0:1789776544.841895:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462043392 00000100:00100000:1.0:1789776544.841959:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 7 00000100:00100000:1.0:1789776544.841969:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+15:10289:x1876716462043392:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:1.0:1789776544.842433:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+16:10289:x1876716462043392:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 465us (676us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1789776544.842439:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 7 00000100:00100000:1.0:1789776545.044402:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776545.044517:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462043520 00000100:00100000:3.0:1789776545.044528:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462043520 00000100:00100000:3.0:1789776545.044611:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 42 00000100:00100000:3.0:1789776545.044622:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86880ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+16:10295:x1876716462043520:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1789776545.044648:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776545.044670:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef3f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2739 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.044743:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef3fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.044759:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef3fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.044771:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef3fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776545.044811:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1789776545.044814:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000100:00080000:2.0:1789776545.044988:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:3.0:1789776545.045028:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef3fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.045056:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef3f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2739 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.045100:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef3fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2739 expref: 17 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.045109:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c8682cbe900) 00010000:00010000:3.0:1789776545.045112:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789776545.045116:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86829e0e00, rc 0) 00000100:00100000:3.0:1789776545.045205:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86880ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+17:10295:x1876716462043520:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 585us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776545.045213:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 42 00000100:00100000:0.0:1789776545.050309:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776545.050471:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462043776 00000100:00100000:3.0:1789776545.050484:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462043776 00000100:00100000:3.0:1789776545.050556:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 43 00000100:00100000:3.0:1789776545.050568:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+17:10295:x1876716462043776:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1789776545.050592:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776545.050617:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031600/0x26940258de8ef401 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2740 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.050744:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031400/0x26940258de8ef408 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.050760:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031400/0x26940258de8ef408 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.050772:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031400/0x26940258de8ef408 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776545.050782:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789776545.050957:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031600/0x26940258de8ef401 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2740 expref: 20 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.050979:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031400/0x26940258de8ef408 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2740 expref: 19 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.050989:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c8682cbe500) 00010000:00010000:3.0:1789776545.050992:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789776545.050997:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8680031400, rc 0) 00000100:00100000:3.0:1789776545.051071:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+19:10295:x1876716462043776:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 505us (773us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1789776545.051079:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 43 00000100:00100000:0.0:1789776545.066518:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776545.066578:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776545.066639:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462044032 00000100:00100000:3.0:1789776545.066658:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462044032 00000100:00100000:1.0:1789776545.066711:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462044160 00000100:00100000:1.0:1789776545.066726:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462044160 00000100:00100000:3.0:1789776545.066770:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 44 00000100:00100000:3.0:1789776545.066793:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8689395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+20:10295:x1876716462044032:12345-192.168.202.6@tcp:101:lfs.0 00000100:00100000:1.0:1789776545.066821:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 2 00010000:00010000:3.0:1789776545.066835:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776545.066864:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031600/0x26940258de8ef416 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2747 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776545.066923:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8689397b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0795fb8a-e14a-4768-806c-f332ad101de7+21:2354:x1876716462044160:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776545.066943:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776545.066967:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031400/0x26940258de8ef408 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2740 expref: 21 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.066990:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030200/0x26940258de8ef41d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776545.066992:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c8682cbe500) 00010000:00010000:1.0:1789776545.067006:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789776545.067020:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030200/0x26940258de8ef41d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.067035:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030200/0x26940258de8ef41d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776545.067066:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8689397b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0795fb8a-e14a-4768-806c-f332ad101de7+20:2354:x1876716462044160:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 148us (487us total) trans 0 rc 0/0 00000004:00200000:3.0:1789776545.067069:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789776545.067571:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031600/0x26940258de8ef416 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2747 expref: 22 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.067594:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030200/0x26940258de8ef41d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2747 expref: 21 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.067603:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c8682cbe500) 00010000:00010000:3.0:1789776545.067607:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789776545.067610:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8680030200, rc 0) 00000100:00100000:3.0:1789776545.067658:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8689395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+21:10295:x1876716462044032:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 877us (1151us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1789776545.067665:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 44 00000100:00100000:1.0:1789776545.071787:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 2 00000100:00100000:2.0:1789776545.087353:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776545.087460:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462044288 00000100:00100000:3.0:1789776545.087470:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462044288 00000100:00100000:3.0:1789776545.087533:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 23 00000100:00100000:3.0:1789776545.087544:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+7:2357:x1876716462044288:12345-192.168.202.6@tcp:1:lfs.0 00010000:00010000:3.0:1789776545.087595:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4194c05/0x26940258de8ef42b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.087618:0:6661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d02cd1be/0x26940258de8ef3de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c272b expref: 7 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.087627:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789776545.087631:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789776545.087636:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4194c05/0x26940258de8ef42b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.087692:0:6661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d02cd1be/0x26940258de8ef3de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c272b expref: 7 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.087708:0:6661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d02cd1be/0x26940258de8ef3de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c272b expref: 7 pid: 6662 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776545.087725:0:6661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9ded880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6661:1876716471515264:192.168.202.6@tcp:104: 00000100:00100000:3.0:1789776545.087948:0:6661:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8682de1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789776545.094073:0:6661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9ded880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6661:1876716471515264:192.168.202.6@tcp:104: 00010000:00010000:0.0:1789776545.094106:0:6661:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a4194c05/0x26940258de8ef42b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776545.097650:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776545.097805:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462044416 00000100:00100000:3.0:1789776545.097819:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462044416 00002000:00100000:3.0:1789776545.097885:0:6665:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9c86ba3bca80 x1876716462044416/t0(0) o4->0795fb8a-e14a-4768-806c-f332ad101de7@192.168.202.6@tcp:736/0 lens 504/0 e 0 to 0 dl 1789776556 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789776545.097896:0:6665:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c86ba3bca80 with x1876716462044416 ext(0->12) 00010000:00010000:3.0:1789776545.097907:0:6665:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d02cd1be/0x26940258de8ef3de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c272b expref: 8 pid: 6662 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.097923:0:6665:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d02cd1be/0x26940258de8ef3de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c272b expref: 8 pid: 6662 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789776545.097932:0:6665:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9c86ba3bca80 00000100:00100000:3.0:1789776545.097966:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 0 00000100:00100000:3.0:1789776545.097976:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba3bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0795fb8a-e14a-4768-806c-f332ad101de7+8:2357:x1876716462044416:12345-192.168.202.6@tcp:4:lfs.0 00000100:00100000:1.0:1789776545.173103:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c8689394700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471515392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789776545.173194:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776545.173524:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471515392 00000100:00100000:0.0:1789776545.173532:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471515392 00000100:00100000:0.0:1789776545.173601:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789776545.173611:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86880cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471515392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789776545.173647:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789776545.173701:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86880cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471515392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776545.173708:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789776545.173762:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c8689394700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471515392:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789776545.173876:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1789776545.184866:0:7615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0795fb8a-e14a-4768-806c-f332ad101de7 00000100:00100000:0.0:1789776545.306664:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba3bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0795fb8a-e14a-4768-806c-f332ad101de7+9:2357:x1876716462044416:12345-192.168.202.6@tcp:4:lfs.0 Request processed in 208676us (209011us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789776545.306684:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 0 00002000:00100000:0.0:1789776545.306699:0:6665:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9c86ba3bca80 x1876716462044416/t4294967299(0) o4->0795fb8a-e14a-4768-806c-f332ad101de7@192.168.202.6@tcp:736/0 lens 504/448 e 0 to 0 dl 1789776556 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789776545.306709:0:6665:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c86ba3bca80 with x1876716462044416 ext(0->12) 00010000:00010000:0.0:1789776545.306720:0:6665:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d02cd1be/0x26940258de8ef3de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c272b expref: 9 pid: 6662 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776545.306739:0:6665:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d02cd1be/0x26940258de8ef3de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c272b expref: 9 pid: 6662 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789776545.306759:0:6665:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9c86ba3bca80 00000001:00080000:2.0:1789776545.307245:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:3.0:1789776545.310877:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776545.311090:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462044544 00000100:00100000:1.0:1789776545.311101:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462044544 00010000:00010000:1.0:1789776545.311158:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d02cd1be/0x26940258de8ef3de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c272b expref: 7 pid: 6662 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776545.311207:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 36 00000100:00100000:1.0:1789776545.311280:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9def100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0795fb8a-e14a-4768-806c-f332ad101de7+7:2355:x1876716462044544:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776545.311298:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789776545.311333:0:5795:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789776545.311337:0:5795:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789776545 00002000:00010000:1.0:1789776545.311339:0:5795:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789776545 00002000:00010000:1.0:1789776545.311341:0:5795:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789776545 00002000:00010000:1.0:1789776545.311344:0:5795:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1789776545.311350:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d02cd1be/0x26940258de8ef3de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c272b expref: 7 pid: 6662 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776545.311367:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d02cd1be/0x26940258de8ef3de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c272b expref: 7 pid: 6662 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776545.311394:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d02cd1be/0x26940258de8ef3de lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c272b expref: 7 pid: 6662 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776545.311416:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=1s v=(1 0) 00010000:00010000:1.0:1789776545.311421:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789776545.311427:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a4194c05/0x26940258de8ef42b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776545.311437:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4194c05/0x26940258de8ef42b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776545.311468:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776545.311526:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9def100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0795fb8a-e14a-4768-806c-f332ad101de7+6:2355:x1876716462044544:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 251us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776545.311546:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 36 00010000:00010000:3.0:1789776545.312249:0:6661:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a4194c05/0x26940258de8ef42b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.312271:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4194c05/0x26940258de8ef42b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.312304:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4194c05/0x26940258de8ef42b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.312424:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4194c05/0x26940258de8ef42b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.312434:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4194c05/0x26940258de8ef42b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.312443:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86829e0a00 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:3.0:1789776545.312448:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4194c05/0x26940258de8ef42b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.312458:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4194c05/0x26940258de8ef42b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.312474:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4194c05/0x26940258de8ef42b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.312482:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4194c05/0x26940258de8ef42b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776545.312574:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+5:2357:x1876716462044288:12345-192.168.202.6@tcp:1:lfs.0 Request processed in 225030us (225229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776545.313727:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 23 00000100:00100000:3.0:1789776545.321033:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776545.321174:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462044800 00000100:00100000:2.0:1789776545.321204:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462044800 00000100:00100000:0.0:1789776545.321573:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 8 00000100:00100000:0.0:1789776545.321596:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9ded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+20:10295:x1876716462044800:12345-192.168.202.6@tcp:35:lfs.0 00000004:00010000:0.0:1789776545.321674:0:5814:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030200/0x26940258de8ef41d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2747 expref: 20 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789776545.322795:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1789776545.322870:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1789776545.324911:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1789776545.325012:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08800/0x26940258de8ef432 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776545.325033:0:5814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef3c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c271d expref: 24 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776545.325043:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08800/0x26940258de8ef432 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776545.325087:0:5814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef3c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c271d expref: 24 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776545.325108:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef3c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c271d expref: 24 pid: 5812 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776545.325123:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c8689394700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5814:1876716471515520:192.168.202.6@tcp:104: 00000100:00100000:0.0:1789776545.325497:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8582caea80 going to sleep for 11 seconds 00000100:00100000:1.0:1789776545.330389:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776545.330633:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c8689394700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5814:1876716471515520:192.168.202.6@tcp:104: 00010000:00010000:0.0:1789776545.330668:0:5814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08800/0x26940258de8ef432 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776545.332352:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462044928 00000100:00100000:3.0:1789776545.332374:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462044928 00010000:00010000:3.0:1789776545.332442:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef3c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c271d expref: 25 pid: 5812 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776545.332507:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 37 00000100:00100000:3.0:1789776545.332641:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86880cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0795fb8a-e14a-4768-806c-f332ad101de7+25:2356:x1876716462044928:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789776545.332664:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776545.332675:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef3c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c271d expref: 25 pid: 5812 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.332694:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef3c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c271d expref: 25 pid: 5812 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.334176:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef3c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c271d expref: 25 pid: 5812 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.334295:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c8682cbe500) 00010000:00010000:3.0:1789776545.334303:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08800/0x26940258de8ef432 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.334318:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08800/0x26940258de8ef432 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.334357:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08800/0x26940258de8ef432 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.334402:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789776545.334469:0:5814:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08800/0x26940258de8ef432 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776545.334490:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08800/0x26940258de8ef432 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776545.334522:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86880cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0795fb8a-e14a-4768-806c-f332ad101de7+24:2356:x1876716462044928:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 1868us (4132us total) trans 0 rc 0/0 00000001:00080000:2.0:1789776545.334663:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1789776545.334906:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1789776545.335060:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bdc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5814:1876716471515648:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789776545.335158:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776545.335196:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86903e6240 going to sleep for 11 seconds 00000100:00100000:1.0:1789776545.335752:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471515648 00000100:00100000:1.0:1789776545.335767:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471515648 00000100:00080000:2.0:1789776545.335852:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789776545.335880:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789776545.335895:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba3bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5814:x1876716471515648:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789776545.335951:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 37 00000100:00100000:1.0:1789776545.336043:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba3bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5814:x1876716471515648:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 153us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776545.336064:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789776545.339323:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bdc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5814:1876716471515648:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789776545.340087:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1789776545.340192:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bdc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5814:1876716471515776:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789776545.340315:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776545.340350:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86903e6840 going to sleep for 11 seconds 00000100:00100000:0.0:1789776545.341730:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471515776 00000100:00100000:0.0:1789776545.341744:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471515776 00000100:00100000:0.0:1789776545.341810:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789776545.341821:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba3bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5814:x1876716471515776:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789776545.342155:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba3bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5814:x1876716471515776:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 335us (1839us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789776545.342163:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789776545.342713:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bdc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5814:1876716471515776:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789776545.342797:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1789776545.342853:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08800/0x26940258de8ef432 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776545.342865:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08800/0x26940258de8ef432 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776545.342872:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08800/0x26940258de8ef432 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776545.342878:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b08800 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776545.342893:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08800/0x26940258de8ef432 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776545.342902:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08800/0x26940258de8ef432 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776545.342919:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c8682cbe500) 00010000:00010000:2.0:1789776545.342923:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789776545.342928:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08800/0x26940258de8ef432 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776545.342934:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08800/0x26940258de8ef432 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789776545.343143:0:5814:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789776545.343550:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1789776545.343563:0:5814:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 298123345751ns, next at 299123343370ns, rc = 0 00000001:00080000:2.0:1789776545.343570:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1789776545.343606:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c8682cbe500) 00010000:00010000:2.0:1789776545.343610:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789776545.343619:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030200/0x26940258de8ef41d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2747 expref: 28 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776545.343896:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9ded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+27:10295:x1876716462044800:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 22301us (22874us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1789776545.343906:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 8 00000020:00080000:2.0:1789776545.343912:0:5814:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789776545.348881:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776545.349163:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462045056 00000100:00100000:3.0:1789776545.349179:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462045056 00000100:00100000:3.0:1789776545.349441:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 45 00000100:00100000:3.0:1789776545.349456:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86880cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+27:10295:x1876716462045056:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1789776545.349491:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776545.349550:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef439 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c274e expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.349639:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef439 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c274e expref: 28 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.349657:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef439 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c274e expref: 28 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.349683:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:3.0:1789776545.349687:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789776545.349691:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86829e0a00, rc 0) 00000100:00100000:3.0:1789776545.349811:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86880cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+28:10295:x1876716462045056:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 359us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776545.349828:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 45 00000100:00100000:1.0:1789776545.355270:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776545.355369:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462045312 00000100:00100000:2.0:1789776545.355387:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462045312 00000100:00100000:2.0:1789776545.355479:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 9 00000100:00100000:2.0:1789776545.355491:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a0684850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+28:10295:x1876716462045312:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:2.0:1789776545.355810:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a0684850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+29:10295:x1876716462045312:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 321us (560us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1789776545.355818:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 9 00000100:00100000:1.0:1789776545.474399:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776545.474579:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462045568 00000100:00100000:3.0:1789776545.474594:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462045568 00000100:00100000:3.0:1789776545.474683:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 46 00000100:00100000:3.0:1789776545.474694:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86880cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+29:10305:x1876716462045568:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1789776545.474731:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776545.474760:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef440 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2755 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776545.474909:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789776545.475071:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef440 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2755 expref: 31 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.475090:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c86881a7800) 00010000:00010000:3.0:1789776545.475094:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789776545.475101:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef440 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2755 expref: 31 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.475124:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86829e1200, rc 0) 00000100:00100000:3.0:1789776545.475311:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86880cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+30:10305:x1876716462045568:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 618us (928us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1789776545.475320:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 46 00000100:00100000:1.0:1789776545.494158:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776545.494467:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462045696 00000100:00100000:0.0:1789776545.494483:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462045696 00000100:00100000:0.0:1789776545.494742:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 47 00000100:00100000:0.0:1789776545.494764:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86880cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+30:10305:x1876716462045696:12345-192.168.202.6@tcp:34:lfs.0 00010000:00010000:0.0:1789776545.494886:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08000/0x26940258de8ef44e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776545.494911:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08000/0x26940258de8ef44e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776545.494925:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08000/0x26940258de8ef44e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776545.494944:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08c00/0x26940258de8ef455 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776545.494950:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08c00/0x26940258de8ef455 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776545.494978:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08c00/0x26940258de8ef455 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776545.495103:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09800/0x26940258de8ef45c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776545.495111:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09800/0x26940258de8ef45c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776545.495118:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09800/0x26940258de8ef45c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789776545.495189:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09800/0x26940258de8ef45c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776545.495205:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08000/0x26940258de8ef44e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776545.495212:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08000/0x26940258de8ef44e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776545.495260:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08000/0x26940258de8ef44e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776545.495267:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b08000 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776545.495272:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08000/0x26940258de8ef44e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776545.495280:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08000/0x26940258de8ef44e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776545.495295:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c8682cbe900) 00010000:00010000:0.0:1789776545.495306:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776545.495313:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08000/0x26940258de8ef44e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776545.495320:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08000/0x26940258de8ef44e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776545.495338:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08c00/0x26940258de8ef455 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776545.495343:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08c00/0x26940258de8ef455 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776545.495349:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08c00/0x26940258de8ef455 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776545.495354:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b08c00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776545.495356:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08c00/0x26940258de8ef455 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776545.495362:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08c00/0x26940258de8ef455 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776545.495369:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c86a08dfe00) 00010000:00010000:0.0:1789776545.495372:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776545.495374:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08c00/0x26940258de8ef455 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776545.495379:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08c00/0x26940258de8ef455 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776545.495396:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09800/0x26940258de8ef45c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776545.495407:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09800/0x26940258de8ef45c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776545.495413:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09800/0x26940258de8ef45c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776545.495419:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b09800 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776545.495422:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09800/0x26940258de8ef45c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776545.495428:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09800/0x26940258de8ef45c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776545.495436:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:0.0:1789776545.495439:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776545.495442:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09800/0x26940258de8ef45c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776545.495448:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09800/0x26940258de8ef45c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776545.496982:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86880cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+30:10305:x1876716462045696:12345-192.168.202.6@tcp:34:lfs.0 Request processed in 2210us (2821us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776545.497169:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 47 00000100:00100000:1.0:1789776545.504396:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776545.504965:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462045952 00000100:00100000:2.0:1789776545.504982:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462045952 00000100:00100000:2.0:1789776545.505367:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00100000:2.0:1789776545.505381:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86880cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+30:10305:x1876716462045952:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:2.0:1789776545.505781:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86880cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+31:10305:x1876716462045952:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 401us (1400us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1789776545.505790:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00100000:1.0:1789776545.576770:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776545.579564:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462046208 00000100:00100000:3.0:1789776545.579591:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462046208 00000100:00100000:3.0:1789776545.579708:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 48 00000100:00100000:3.0:1789776545.579724:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86880ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+31:10308:x1876716462046208:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1789776545.579760:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776545.579802:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef463 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c275c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.579944:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef46a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.579966:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef46a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.579982:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef46a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.580001:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030200/0x26940258de8ef471 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.580009:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030200/0x26940258de8ef471 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.580016:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030200/0x26940258de8ef471 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.580542:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031400/0x26940258de8ef478 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.580556:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031400/0x26940258de8ef478 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.580565:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031400/0x26940258de8ef478 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776545.580580:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789776545.580718:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef46a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.580727:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef46a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.580745:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef46a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.580752:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86829e0400 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776545.580758:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef46a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.580768:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef46a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.580783:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c8682cbe900) 00010000:00010000:3.0:1789776545.580786:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776545.580792:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef46a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.580799:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef46a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.580882:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030200/0x26940258de8ef471 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.580889:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030200/0x26940258de8ef471 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.580895:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030200/0x26940258de8ef471 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.580900:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8680030200 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776545.580904:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030200/0x26940258de8ef471 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.580920:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030200/0x26940258de8ef471 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.580930:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c8682cbe800) 00010000:00010000:3.0:1789776545.580932:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776545.580935:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030200/0x26940258de8ef471 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.580942:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030200/0x26940258de8ef471 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.581005:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef463 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c275c expref: 34 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.581023:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031400/0x26940258de8ef478 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c275c expref: 33 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.581031:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:3.0:1789776545.581034:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789776545.581036:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8680031400, rc 0) 00000100:00100000:3.0:1789776545.581619:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86880ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+33:10308:x1876716462046208:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 1608us (5275us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1789776545.581632:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 48 00000100:00100000:1.0:1789776545.585670:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776545.585799:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462046336 00000100:00100000:3.0:1789776545.585823:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462046336 00000100:00100000:3.0:1789776545.585898:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 49 00000100:00100000:3.0:1789776545.585909:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+33:10308:x1876716462046336:12345-192.168.202.6@tcp:54:lfs.0 00010000:00010000:3.0:1789776545.586018:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031600/0x26940258de8ef486 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.586040:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031600/0x26940258de8ef486 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.586055:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031600/0x26940258de8ef486 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.586091:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031600/0x26940258de8ef486 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.586098:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031600/0x26940258de8ef486 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.586106:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031600/0x26940258de8ef486 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.586114:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8680031600 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776545.586119:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031600/0x26940258de8ef486 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.586142:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031600/0x26940258de8ef486 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.586157:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:3.0:1789776545.586161:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789776545.586167:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031600/0x26940258de8ef486 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776545.586174:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031600/0x26940258de8ef486 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776545.586556:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+33:10308:x1876716462046336:12345-192.168.202.6@tcp:54:lfs.0 Request processed in 646us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776545.586565:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 49 00000100:00100000:1.0:1789776545.596783:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776545.597446:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462046592 00000100:00100000:0.0:1789776545.597462:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462046592 00000100:00100000:0.0:1789776545.597547:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 11 00000100:00100000:0.0:1789776545.597561:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+33:10308:x1876716462046592:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:0.0:1789776545.598189:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+34:10308:x1876716462046592:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 627us (1428us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1789776545.599258:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 11 00010000:00010000:1.0:1789776545.694329:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789776545.864573:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967330 is committed 00000004:00080000:1.0:1789776545.864623:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:1.0:1789776545.864650:0:5833:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c86903e6240 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1789776545.864657:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c86aa269200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c86903e6cc0 00000020:00080000:1.0:1789776545.864661:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c86aa269000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c86af75e400 00000020:00080000:3.0:1789776545.864740:0:5844:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1789776545.865105:0:5844:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1789776545.866199:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789776545.866276:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471515904:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789776545.866382:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776545.866976:0:8384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471515904 00000100:00100000:1.0:1789776545.866988:0:8384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471515904 00000100:00100000:1.0:1789776545.867071:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789776545.867200:0:8384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8689394700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3274:x1876716471515904:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789776545.867266:0:8384:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1789776545.867313:0:8384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aadd2a1, atime: 0x6aadd2a1, ctime: 0x6aadd2a1, blocks: 0xb 00010000:00010000:1.0:1789776545.867322:0:8384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001afed1bb/0x26940258de8ef48d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776545.867344:0:8384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=298s v=(0 0) 00010000:00010000:1.0:1789776545.867349:0:8384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776545.867358:0:8384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001afed1bb/0x26940258de8ef48d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776545.867374:0:8384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001afed1bb/0x26940258de8ef48d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776545.867386:0:8384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001afed1bb/0x26940258de8ef48d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776545.867395:0:8384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001afed1bb/0x26940258de8ef48d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776545.867416:0:8384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789776545.870439:0:8384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8689394700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3274:x1876716471515904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3229us (4043us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789776545.870459:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1789776545.870522:0:8419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776545.870535:0:8419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001afed1bb/0x26940258de8ef48d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776545.870569:0:8419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5ca800 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:1.0:1789776545.870575:0:8419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001afed1bb/0x26940258de8ef48d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776545.870588:0:8419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001afed1bb/0x26940258de8ef48d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776545.870615:0:8419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001afed1bb/0x26940258de8ef48d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776545.870624:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001afed1bb/0x26940258de8ef48d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776545.870656:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776545.870659:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776545.870660:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789776545.872270:0:3274:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c86ba3bf480/2, rc 0, transno 4294967301 00000100:00100000:0.0:1789776545.872293:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471515904:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789776545.939393:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776545.939518:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462046848 00000100:00100000:2.0:1789776545.939533:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462046848 00000100:00100000:2.0:1789776545.939618:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 50 00000100:00100000:2.0:1789776545.939631:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8689394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+12:10339:x1876716462046848:12345-192.168.202.6@tcp:101:cat.0 00010000:00010000:2.0:1789776545.939665:0:8177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776545.939694:0:8177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7000/0x26940258de8ef494 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2763 expref: -99 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776545.939827:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8ef49b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776545.939846:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8ef49b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776545.939860:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8ef49b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776545.939876:0:8177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789776545.940209:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7000/0x26940258de8ef494 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2763 expref: 15 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776545.940300:0:8177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8ef49b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2763 expref: 14 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776545.940312:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:2.0:1789776545.940316:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789776545.940322:0:8177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c868afc6c00, rc 0) 00000100:00100000:2.0:1789776545.940401:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8689394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+14:10339:x1876716462046848:12345-192.168.202.6@tcp:101:cat.0 Request processed in 772us (1039us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1789776545.940410:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 50 00000100:00100000:1.0:1789776545.948491:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776545.948556:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776545.948784:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462047104 00000100:00100000:2.0:1789776545.948800:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462047104 00000100:00100000:2.0:1789776545.948877:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 12 00000100:00100000:2.0:1789776545.948891:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+14:10339:x1876716462047104:12345-192.168.202.6@tcp:35:cat.0 00000100:00100000:2.0:1789776545.949381:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+15:10339:x1876716462047104:12345-192.168.202.6@tcp:35:cat.0 Request processed in 490us (906us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1789776545.949392:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 12 00000100:00100000:0.0:1789776545.949514:0:11143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462047232 00000100:00100000:0.0:1789776545.949520:0:11143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462047232 00000100:00100000:0.0:1789776545.949566:0:11143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 3 00000100:00100000:0.0:1789776545.949575:0:11143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c869880dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0795fb8a-e14a-4768-806c-f332ad101de7+15:2357:x1876716462047232:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789776545.949590:0:11143:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776545.949625:0:11143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8ef49b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2763 expref: 15 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776545.949652:0:11143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:0.0:1789776545.949659:0:11143:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776545.949696:0:11143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c869880dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0795fb8a-e14a-4768-806c-f332ad101de7+14:2357:x1876716462047232:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 123us (1139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776545.949703:0:11143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 3 00000100:00100000:1.0:1789776546.019377:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776546.019679:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462047488 00000100:00100000:0.0:1789776546.019693:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462047488 00000100:00100000:0.0:1789776546.019836:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 51 00000100:00100000:0.0:1789776546.019849:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+14:10345:x1876716462047488:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:0.0:1789776546.019883:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776546.019905:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789776546.019941:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef3fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2739 expref: 14 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776546.019972:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c8682cbe900) 00010000:00010000:0.0:1789776546.019979:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789776546.019998:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08c00/0x26940258de8ef4a9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c276a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776546.020181:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08000/0x26940258de8ef4b0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776546.020199:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031400/0x26940258de8ef478 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c275c expref: 14 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776546.020208:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08000/0x26940258de8ef4b0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776546.020341:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031400/0x26940258de8ef478 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c275c expref: 14 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776546.020360:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031400/0x26940258de8ef478 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c275c expref: 14 pid: 5812 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776546.020379:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c8689397b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1876716471516032:192.168.202.6@tcp:104: 00000100:00100000:0.0:1789776546.020516:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8682de1000 going to sleep for 11 seconds 00000100:00100000:0.0:1789776546.026118:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c8689397b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1876716471516032:192.168.202.6@tcp:104: 00010000:00010000:0.0:1789776546.026173:0:5813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08000/0x26940258de8ef4b0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776546.026713:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776546.026830:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462047616 00000100:00100000:1.0:1789776546.026841:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462047616 00010000:00010000:1.0:1789776546.026895:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031400/0x26940258de8ef478 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c275c expref: 15 pid: 5812 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776546.026940:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 38 00000100:00100000:1.0:1789776546.026952:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bff62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0795fb8a-e14a-4768-806c-f332ad101de7+15:2356:x1876716462047616:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776546.026987:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776546.026995:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031400/0x26940258de8ef478 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c275c expref: 15 pid: 5812 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.027011:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031400/0x26940258de8ef478 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c275c expref: 15 pid: 5812 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.027044:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031400/0x26940258de8ef478 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c275c expref: 15 pid: 5812 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.027071:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:1.0:1789776546.027077:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08000/0x26940258de8ef4b0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.027101:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08000/0x26940258de8ef4b0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.027111:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08000/0x26940258de8ef4b0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.027166:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776546.027282:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bff62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0795fb8a-e14a-4768-806c-f332ad101de7+14:2356:x1876716462047616:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 330us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776546.027291:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 38 00010000:00010000:2.0:1789776546.027553:0:5813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08000/0x26940258de8ef4b0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.027562:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08000/0x26940258de8ef4b0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776546.027590:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789776546.027845:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08c00/0x26940258de8ef4a9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c276a expref: 15 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.027877:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08000/0x26940258de8ef4b0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c276a expref: 14 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.027884:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:2.0:1789776546.027887:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789776546.027890:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86b9b08000, rc 0) 00000100:00100000:2.0:1789776546.027926:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+14:10345:x1876716462047488:12345-192.168.202.6@tcp:101:dd.0 Request processed in 8081us (8566us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1789776546.027934:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 51 00000100:00100000:1.0:1789776546.033031:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776546.033551:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462047872 00000100:00100000:3.0:1789776546.033568:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462047872 00000100:00100000:3.0:1789776546.033662:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 52 00000100:00100000:3.0:1789776546.033675:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+14:10345:x1876716462047872:12345-192.168.202.6@tcp:36:dd.0 00010000:00010000:3.0:1789776546.034093:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031600/0x26940258de8ef4be lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776546.034120:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031600/0x26940258de8ef4be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776546.034146:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031600/0x26940258de8ef4be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789776546.034264:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1789776546.034297:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009a8ec0a5 reply state 00000000f73a6889 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031600/0x26940258de8ef4be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776546.034308:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789776546.034615:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+17:10345:x1876716462047872:12345-192.168.202.6@tcp:36:dd.0 Request processed in 939us (1597us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1789776546.034623:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 52 00000020:00080000:3.0:1789776546.034629:0:5812:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789776546.047965:0:3260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031600/0x26940258de8ef4be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776546.048019:0:3260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031600/0x26940258de8ef4be lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776546.048029:0:3260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031600/0x26940258de8ef4be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776546.048036:0:3260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8680031600 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776546.048043:0:3260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031600/0x26940258de8ef4be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776546.048846:0:3260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031600/0x26940258de8ef4be lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776546.048875:0:3260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:3.0:1789776546.048878:0:3260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776546.048884:0:3260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031600/0x26940258de8ef4be lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776546.048892:0:3260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031600/0x26940258de8ef4be lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776546.197362:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9ded880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471516544:0@lo:400:kworker.0 00000100:00100000:2.0:1789776546.197480:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776546.197586:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789776546.197592:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9db43398-240e-4f78-8778-c11d527e09a1:3273:1876716471516160:0@lo:400:kworker.0 00000100:00100000:2.0:1789776546.197626:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776546.197650:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a01dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3273:1876716471516672:0@lo:400:kworker.0 00000100:00100000:2.0:1789776546.197678:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776546.198080:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9def100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3275:1876716471516288:0@lo:400:kworker.0 00000100:00100000:1.0:1789776546.198140:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776546.198161:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789776546.198187:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9dee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3275:1876716471516416:0@lo:400:kworker.0 00000100:00100000:1.0:1789776546.198211:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776546.198448:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471516160 00000100:00100000:1.0:1789776546.198460:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471516160 00000100:00100000:1.0:1789776546.198525:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1789776546.198536:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa5db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+19:3273:x1876716471516160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776546.198605:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa5db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+19:3273:x1876716471516160:12345-0@lo:400:kworker.0 Request processed in 70us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776546.198613:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1789776546.198687:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9db43398-240e-4f78-8778-c11d527e09a1:3273:1876716471516160:0@lo:400:kworker.0 00000100:00100000:1.0:1789776546.198717:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471516672 00000100:00100000:1.0:1789776546.198721:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471516672 00000100:00100000:1.0:1789776546.198761:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471516288 00000100:00100000:1.0:1789776546.198764:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471516288 00000100:00100000:3.0:1789776546.199242:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471516544 00000100:00100000:3.0:1789776546.199248:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471516544 00000100:00100000:3.0:1789776546.199284:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789776546.199292:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471516544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776546.199354:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471516544:12345-0@lo:400:kworker.0 Request processed in 64us (1876us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776546.199360:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789776546.199389:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471516416 00000100:00100000:3.0:1789776546.199393:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471516416 00000100:00100000:3.0:1789776546.199426:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789776546.199431:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1876716471516672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776546.199462:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1876716471516672:12345-0@lo:400:kworker.0 Request processed in 31us (1783us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776546.199468:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789776546.199479:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789776546.199484:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1876716471516416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776546.199513:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1876716471516416:12345-0@lo:400:kworker.0 Request processed in 29us (1301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776546.199518:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:3.0:1789776546.199553:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789776546.199587:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a01dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3273:1876716471516672:0@lo:400:kworker.0 00000100:00100000:3.0:1789776546.199598:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9ded880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471516544:0@lo:400:kworker.0 00000100:00100000:3.0:1789776546.199630:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9dee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3275:1876716471516416:0@lo:400:kworker.0 00000100:00100000:1.0:1789776546.199931:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789776546.199940:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1876716471516288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776546.199979:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1876716471516288:12345-0@lo:400:kworker.0 Request processed in 42us (1839us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776546.199985:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789776546.200013:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9def100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3275:1876716471516288:0@lo:400:kworker.0 00000100:00100000:1.0:1789776546.298785:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776546.299275:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462048000 00000100:00100000:3.0:1789776546.299292:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462048000 00000100:00100000:3.0:1789776546.299388:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 53 00000100:00100000:3.0:1789776546.299401:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+16:10359:x1876716462048000:12345-192.168.202.6@tcp:101:stat.0 00010000:00010000:3.0:1789776546.299436:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776546.299466:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031600/0x26940258de8ef4c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2771 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776546.299562:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030200/0x26940258de8ef4cc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776546.299582:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030200/0x26940258de8ef4cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776546.299619:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030200/0x26940258de8ef4cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776546.299641:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031400/0x26940258de8ef4d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776546.299648:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031400/0x26940258de8ef4d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776546.299654:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031400/0x26940258de8ef4d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776546.300574:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef4da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776546.300595:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08000/0x26940258de8ef4b0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c276a expref: 17 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776546.300605:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef4da lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776546.300655:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08000/0x26940258de8ef4b0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c276a expref: 17 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776546.300677:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08000/0x26940258de8ef4b0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c276a expref: 17 pid: 5813 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776546.300697:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a01dc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1876716471516800:192.168.202.6@tcp:104: 00000100:00100000:3.0:1789776546.301947:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8582cae000 going to sleep for 11 seconds 00000100:00100000:1.0:1789776546.305319:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776546.305672:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a01dc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1876716471516800:192.168.202.6@tcp:104: 00010000:00010000:3.0:1789776546.305712:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef4da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776546.305825:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462048256 00000100:00100000:2.0:1789776546.305835:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462048256 00000100:00100000:2.0:1789776546.305916:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 13 00000100:00100000:2.0:1789776546.305928:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+18:5596:x1876716462048256:12345-192.168.202.6@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789776546.306492:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+19:5596:x1876716462048256:12345-192.168.202.6@tcp:35:ldlm_bl.0 Request processed in 562us (1184us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1789776546.306501:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 13 00000100:00100000:2.0:1789776546.311514:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776546.311719:0:11142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462048384 00000100:00100000:3.0:1789776546.311735:0:11142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462048384 00010000:00010000:3.0:1789776546.311805:0:11142:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08000/0x26940258de8ef4b0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c276a expref: 19 pid: 5813 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776546.311870:0:11142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 39 00000100:00100000:3.0:1789776546.311882:0:11142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf764e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0795fb8a-e14a-4768-806c-f332ad101de7+19:2356:x1876716462048384:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789776546.311901:0:11142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776546.311909:0:11142:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08000/0x26940258de8ef4b0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c276a expref: 19 pid: 5813 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776546.311925:0:11142:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08000/0x26940258de8ef4b0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c276a expref: 19 pid: 5813 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776546.311956:0:11142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08000/0x26940258de8ef4b0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c276a expref: 19 pid: 5813 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776546.311978:0:11142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:3.0:1789776546.311984:0:11142:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef4da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776546.311996:0:11142:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef4da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776546.312004:0:11142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef4da lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776546.312278:0:11142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776546.312370:0:11142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf764e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0795fb8a-e14a-4768-806c-f332ad101de7+18:2356:x1876716462048384:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 490us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776546.312379:0:11142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 39 00010000:00010000:1.0:1789776546.316635:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef4da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.316664:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef4da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776546.316788:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789776546.316794:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789776546.316877:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef4da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.316900:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef4da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.316913:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030200/0x26940258de8ef4cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.316921:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030200/0x26940258de8ef4cc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.316930:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030200/0x26940258de8ef4cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.316936:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8680030200 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776546.316942:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030200/0x26940258de8ef4cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.316951:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030200/0x26940258de8ef4cc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.316989:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c8682cbe900) 00010000:00010000:1.0:1789776546.316993:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776546.317001:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030200/0x26940258de8ef4cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.317010:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030200/0x26940258de8ef4cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.317055:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031400/0x26940258de8ef4d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.317063:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031400/0x26940258de8ef4d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.317069:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031400/0x26940258de8ef4d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.317075:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8680031400 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776546.317078:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031400/0x26940258de8ef4d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.317084:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031400/0x26940258de8ef4d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.317104:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c8682cbef00) 00010000:00010000:1.0:1789776546.317107:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776546.317111:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031400/0x26940258de8ef4d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.317117:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031400/0x26940258de8ef4d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.317192:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031600/0x26940258de8ef4c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2771 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.317210:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef4da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2771 expref: 17 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.317920:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:1.0:1789776546.317923:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789776546.317927:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86829e0e00, rc 0) 00000100:00100000:1.0:1789776546.318088:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+17:10359:x1876716462048000:12345-192.168.202.6@tcp:101:stat.0 Request processed in 18687us (19323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776546.318108:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 53 00000100:00100000:2.0:1789776546.408024:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776546.409767:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462048640 00000100:00100000:0.0:1789776546.409800:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462048640 00000100:00100000:0.0:1789776546.410015:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 54 00000100:00100000:0.0:1789776546.410028:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+17:10365:x1876716462048640:12345-192.168.202.6@tcp:36:truncate.0 00010000:00010000:0.0:1789776546.410116:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776546.410164:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef4da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2771 expref: 17 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776546.410200:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:0.0:1789776546.410207:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789776546.410996:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8ef4e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776546.411021:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8ef4e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776546.411035:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8ef4e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789776546.411106:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1789776546.411148:0:5813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000c3406c4 reply state 00000000cb6a487e transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8ef4e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776546.411159:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789776546.411948:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+19:10365:x1876716462048640:12345-192.168.202.6@tcp:36:truncate.0 Request processed in 1915us (3930us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1789776546.411959:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 54 00000020:00080000:0.0:1789776546.411966:0:5813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789776546.413582:0:3259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8ef4e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.413605:0:3259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8ef4e1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.413614:0:3259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8ef4e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.413620:0:3259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b09a00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776546.413626:0:3259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8ef4e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.413635:0:3259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8ef4e1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.413657:0:3259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:2.0:1789776546.413660:0:3259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776546.413665:0:3259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8ef4e1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.413669:0:3259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8ef4e1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776546.589587:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776546.590168:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462048768 00000100:00100000:1.0:1789776546.590184:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462048768 00000100:00100000:2.0:1789776546.590670:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 55 00000100:00100000:2.0:1789776546.590689:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+18:10379:x1876716462048768:12345-192.168.202.6@tcp:101:stat.0 00010000:00010000:2.0:1789776546.590729:0:8177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776546.590764:0:8177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775400/0x26940258de8ef4e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2778 expref: -99 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.590891:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775600/0x26940258de8ef4ef lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.590925:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775600/0x26940258de8ef4ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.590941:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775600/0x26940258de8ef4ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.590961:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775e00/0x26940258de8ef4f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.590968:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775e00/0x26940258de8ef4f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.590975:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775e00/0x26940258de8ef4f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.592459:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8ef4fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.592483:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8ef4fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.592496:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8ef4fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776546.592552:0:8177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1789776546.592558:0:8177:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789776546.592591:0:8177:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8ef4fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.592618:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8ef4fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.592629:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775600/0x26940258de8ef4ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.592636:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775600/0x26940258de8ef4ef lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.592642:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775600/0x26940258de8ef4ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.592648:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8686775600 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776546.592653:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775600/0x26940258de8ef4ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.592663:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775600/0x26940258de8ef4ef lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.592679:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c8682cbe900) 00010000:00010000:2.0:1789776546.592683:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776546.592688:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775600/0x26940258de8ef4ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.592695:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775600/0x26940258de8ef4ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.592712:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775e00/0x26940258de8ef4f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.592718:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775e00/0x26940258de8ef4f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.592728:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775e00/0x26940258de8ef4f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.592733:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8686775e00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776546.592736:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775e00/0x26940258de8ef4f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.592742:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775e00/0x26940258de8ef4f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.592749:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c86881a7000) 00010000:00010000:2.0:1789776546.592751:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776546.592754:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775e00/0x26940258de8ef4f6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.592759:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775e00/0x26940258de8ef4f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.592807:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775400/0x26940258de8ef4e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2778 expref: 20 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.592822:0:8177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8ef4fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2778 expref: 19 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.592830:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:2.0:1789776546.592832:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789776546.592835:0:8177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8686775000, rc 0) 00000100:00100000:2.0:1789776546.593339:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+19:10379:x1876716462048768:12345-192.168.202.6@tcp:101:stat.0 Request processed in 2653us (3764us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776546.593358:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 55 00000100:00100000:3.0:1789776546.671512:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776546.677039:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462049024 00000100:00100000:0.0:1789776546.677066:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462049024 00000100:00100000:0.0:1789776546.680978:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 56 00000100:00100000:0.0:1789776546.680999:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+19:10389:x1876716462049024:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1789776546.681026:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776546.681051:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef504 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c277f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776546.681192:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789776546.681358:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef504 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c277f expref: 21 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776546.681390:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c86881a7800) 00010000:00010000:0.0:1789776546.681393:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789776546.681400:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef504 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c277f expref: 21 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776546.681416:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86b9b09000, rc 0) 00000100:00100000:0.0:1789776546.681500:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+20:10389:x1876716462049024:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 510us (10002us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1789776546.681506:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 56 00000100:00100000:0.0:1789776546.691764:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776546.691848:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462049280 00000100:00100000:2.0:1789776546.691863:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462049280 00000100:00100000:2.0:1789776546.691931:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 14 00000100:00100000:2.0:1789776546.691940:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8689397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+20:10389:x1876716462049280:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:2.0:1789776546.692293:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8689397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+21:10389:x1876716462049280:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 354us (543us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1789776546.692299:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 14 00010000:00010000:3.0:1789776546.709078:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776546.709532:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789776546.709564:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471516928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789776546.709678:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776546.710043:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471516928 00000100:00100000:2.0:1789776546.710056:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471516928 00000100:00100000:2.0:1789776546.710152:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789776546.710166:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8689395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3276:x1876716471516928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789776546.710265:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789776546.710643:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8689395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3276:x1876716471516928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 478us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776546.710652:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789776546.710767:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471516928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789776546.761408:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776546.761658:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462049536 00000100:00100000:3.0:1789776546.761674:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462049536 00000100:00100000:3.0:1789776546.761758:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 57 00000100:00100000:3.0:1789776546.761782:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+21:10394:x1876716462049536:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:3.0:1789776546.761833:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776546.761869:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef512 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2786 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776546.762038:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef519 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776546.762056:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8ef4fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2778 expref: 22 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776546.762067:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef519 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776546.762114:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8ef4fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2778 expref: 22 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776546.762141:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8ef4fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2778 expref: 22 pid: 8177 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776546.762187:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a01df480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1876716471517056:192.168.202.6@tcp:104: 00000100:00100000:3.0:1789776546.762717:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8582cae000 going to sleep for 11 seconds 00000100:00100000:1.0:1789776546.774018:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a01df480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1876716471517056:192.168.202.6@tcp:104: 00010000:00010000:1.0:1789776546.774061:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef519 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776546.775975:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776546.776373:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462049664 00000100:00100000:3.0:1789776546.776390:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462049664 00010000:00010000:3.0:1789776546.776453:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8ef4fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2778 expref: 23 pid: 8177 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776546.776512:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 40 00000100:00100000:3.0:1789776546.776524:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0795fb8a-e14a-4768-806c-f332ad101de7+23:2357:x1876716462049664:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789776546.776544:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776546.776552:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8ef4fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2778 expref: 23 pid: 8177 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776546.776585:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8ef4fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2778 expref: 23 pid: 8177 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776546.776618:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8ef4fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2778 expref: 23 pid: 8177 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776546.776643:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:3.0:1789776546.776650:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef519 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776546.776662:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef519 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776546.776702:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef519 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776546.776742:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776546.777002:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0795fb8a-e14a-4768-806c-f332ad101de7+22:2357:x1876716462049664:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 478us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776546.777010:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 40 00010000:00010000:1.0:1789776546.778169:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef519 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.778184:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef519 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776546.778214:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1789776546.778500:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef512 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2786 expref: 23 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.778534:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef519 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2786 expref: 22 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.778569:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:1.0:1789776546.778573:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789776546.778578:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86829e1200, rc 0) 00000100:00100000:1.0:1789776546.778671:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+22:10394:x1876716462049536:12345-192.168.202.6@tcp:101:bash.0 Request processed in 16902us (17280us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1789776546.778681:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 57 00000100:00100000:1.0:1789776546.786873:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776546.786992:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462049920 00000100:00100000:2.0:1789776546.787004:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462049920 00000100:00100000:2.0:1789776546.787069:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 58 00000100:00100000:2.0:1789776546.787079:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+22:10394:x1876716462049920:12345-192.168.202.6@tcp:36:bash.0 00010000:00010000:2.0:1789776546.787684:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775600/0x26940258de8ef527 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.787711:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775600/0x26940258de8ef527 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.787725:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775600/0x26940258de8ef527 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789776546.790101:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1789776546.790209:0:5813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000746bc789 reply state 000000009ca38542 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775600/0x26940258de8ef527 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776546.790242:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789776546.791688:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+25:10394:x1876716462049920:12345-192.168.202.6@tcp:36:bash.0 Request processed in 4593us (4811us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1789776546.791703:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 58 00000020:00080000:2.0:1789776546.791713:0:5813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789776546.799727:0:3260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775600/0x26940258de8ef527 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776546.799792:0:3260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775600/0x26940258de8ef527 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776546.799801:0:3260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775600/0x26940258de8ef527 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776546.799810:0:3260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8686775600 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776546.799816:0:3260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775600/0x26940258de8ef527 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776546.799827:0:3260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775600/0x26940258de8ef527 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776546.799852:0:3260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:0.0:1789776546.799856:0:3260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776546.799862:0:3260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775600/0x26940258de8ef527 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776546.799870:0:3260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775600/0x26940258de8ef527 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776546.801943:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776546.802143:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462050048 00000100:00100000:2.0:1789776546.802160:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462050048 00000100:00100000:2.0:1789776546.804755:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 59 00000100:00100000:2.0:1789776546.805936:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+24:10394:x1876716462050048:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:2.0:1789776546.805975:0:8177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776546.806004:0:8177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8ef52e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c278d expref: -99 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.806132:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775800/0x26940258de8ef535 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.806152:0:8177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef519 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2786 expref: 25 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.806162:0:8177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775800/0x26940258de8ef535 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.806211:0:8177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef519 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2786 expref: 25 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.806270:0:8177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef519 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2786 expref: 25 pid: 5812 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776546.806285:0:8177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf766a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8177:1876716471517184:192.168.202.6@tcp:104: 00000100:00100000:2.0:1789776546.806622:0:8177:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86903e6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789776546.812145:0:8177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf766a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8177:1876716471517184:192.168.202.6@tcp:104: 00010000:00010000:3.0:1789776546.812191:0:8177:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775800/0x26940258de8ef535 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776546.812740:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776546.814975:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462050176 00000100:00100000:3.0:1789776546.814999:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462050176 00010000:00010000:3.0:1789776546.815072:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef519 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2786 expref: 26 pid: 5812 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776546.815149:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 41 00000100:00100000:3.0:1789776546.815161:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0795fb8a-e14a-4768-806c-f332ad101de7+26:2357:x1876716462050176:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789776546.815183:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776546.815190:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef519 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2786 expref: 26 pid: 5812 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776546.815206:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef519 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2786 expref: 26 pid: 5812 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776546.815883:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef519 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2786 expref: 26 pid: 5812 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776546.815942:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:3.0:1789776546.815949:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775800/0x26940258de8ef535 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776546.815961:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775800/0x26940258de8ef535 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776546.815971:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775800/0x26940258de8ef535 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776546.816078:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776546.816179:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0795fb8a-e14a-4768-806c-f332ad101de7+25:2357:x1876716462050176:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 1019us (3440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776546.816190:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 41 00010000:00010000:2.0:1789776546.817126:0:8177:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775800/0x26940258de8ef535 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.817143:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775800/0x26940258de8ef535 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776546.817234:0:8177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789776546.817239:0:8177:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789776546.817270:0:8177:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775800/0x26940258de8ef535 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.817495:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8ef52e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c278d expref: 25 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.817518:0:8177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775800/0x26940258de8ef535 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c278d expref: 24 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.817528:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:2.0:1789776546.817532:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789776546.817536:0:8177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8686775800, rc 0) 00000100:00100000:2.0:1789776546.817605:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+24:10394:x1876716462050048:12345-192.168.202.6@tcp:101:bash.0 Request processed in 11708us (15680us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776546.817633:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 59 00000100:00100000:1.0:1789776546.824208:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776546.824902:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462050432 00000100:00100000:3.0:1789776546.824922:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462050432 00000100:00100000:2.0:1789776546.825131:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 15 00000100:00100000:2.0:1789776546.825144:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a0687450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+24:10394:x1876716462050432:12345-192.168.202.6@tcp:35:bash.0 00000100:00100000:2.0:1789776546.825560:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a0687450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+25:10394:x1876716462050432:12345-192.168.202.6@tcp:35:bash.0 Request processed in 417us (1368us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1789776546.825569:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 15 00000100:00100000:3.0:1789776546.913984:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776546.914342:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462050688 00000100:00100000:0.0:1789776546.914355:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462050688 00000100:00100000:0.0:1789776546.914434:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 60 00000100:00100000:0.0:1789776546.914444:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+25:10405:x1876716462050688:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1789776546.914474:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776546.914501:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8ef53c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2794 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776546.914623:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789776546.915074:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8ef53c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2794 expref: 27 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776546.915089:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c86881a7800) 00010000:00010000:0.0:1789776546.915092:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789776546.915098:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8ef53c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2794 expref: 27 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776546.915125:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86b9b08a00, rc 0) 00000100:00100000:0.0:1789776546.915268:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+26:10405:x1876716462050688:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 825us (1299us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1789776546.915275:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 60 00000100:00100000:0.0:1789776546.918998:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776546.919097:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462050816 00000100:00100000:1.0:1789776546.919112:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462050816 00000100:00100000:1.0:1789776546.919201:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 61 00000100:00100000:1.0:1789776546.919211:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8689397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+26:10405:x1876716462050816:12345-192.168.202.6@tcp:34:lfs.0 00010000:00010000:1.0:1789776546.919705:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8ef54a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.919723:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8ef54a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.919734:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8ef54a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.919747:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef551 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.919752:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef551 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.919843:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef551 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.920139:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef558 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.920150:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef558 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.920157:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef558 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789776546.920736:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef558 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.920753:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8ef54a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.920758:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8ef54a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.920763:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8ef54a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.920775:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5cae00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776546.920778:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8ef54a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.920784:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8ef54a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.920797:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c8682cbe900) 00010000:00010000:1.0:1789776546.920811:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776546.920818:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8ef54a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.920825:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8ef54a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.920843:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef551 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.920850:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef551 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.920856:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef551 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.920862:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5cb400 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776546.920865:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef551 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.920870:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef551 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.920876:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c8683789d00) 00010000:00010000:1.0:1789776546.920877:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776546.920879:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef551 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.920883:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef551 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.920903:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef558 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.920911:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef558 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.920915:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef558 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.920918:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5cbc00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776546.920919:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef558 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.920923:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef558 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.920927:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:1.0:1789776546.920928:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776546.920930:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef558 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776546.920933:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef558 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776546.921100:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8689397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+26:10405:x1876716462050816:12345-192.168.202.6@tcp:34:lfs.0 Request processed in 1885us (2109us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776546.921110:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 61 00000100:00100000:1.0:1789776546.925725:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776546.925829:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462051072 00000100:00100000:0.0:1789776546.925845:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462051072 00000100:00100000:0.0:1789776546.925927:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 16 00000100:00100000:0.0:1789776546.925939:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+26:10405:x1876716462051072:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:0.0:1789776546.926286:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+27:10405:x1876716462051072:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 349us (579us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1789776546.926292:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 16 00000100:00100000:3.0:1789776546.959315:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776546.959836:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462051328 00000100:00100000:2.0:1789776546.959853:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462051328 00000100:00100000:2.0:1789776546.959947:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 62 00000100:00100000:2.0:1789776546.959962:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+27:10408:x1876716462051328:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1789776546.960002:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776546.960032:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8ef55f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c279b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.960169:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775a00/0x26940258de8ef566 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.960190:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775a00/0x26940258de8ef566 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.960206:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775a00/0x26940258de8ef566 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.960268:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774c00/0x26940258de8ef56d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.960277:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774c00/0x26940258de8ef56d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.960307:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774c00/0x26940258de8ef56d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.961004:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774000/0x26940258de8ef574 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.961019:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774000/0x26940258de8ef574 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.961028:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774000/0x26940258de8ef574 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776546.961040:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789776546.961182:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775a00/0x26940258de8ef566 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.961192:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775a00/0x26940258de8ef566 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.961199:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775a00/0x26940258de8ef566 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.961206:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8686775a00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776546.961212:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775a00/0x26940258de8ef566 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.961257:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775a00/0x26940258de8ef566 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.961271:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c8682cbe900) 00010000:00010000:2.0:1789776546.961274:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776546.961286:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775a00/0x26940258de8ef566 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.961293:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775a00/0x26940258de8ef566 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.961309:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774c00/0x26940258de8ef56d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.961316:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774c00/0x26940258de8ef56d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.961322:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774c00/0x26940258de8ef56d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.961327:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8686774c00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776546.961330:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774c00/0x26940258de8ef56d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.961336:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774c00/0x26940258de8ef56d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.961343:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c86881a7000) 00010000:00010000:2.0:1789776546.961346:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776546.961349:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774c00/0x26940258de8ef56d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.961354:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774c00/0x26940258de8ef56d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.961416:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8ef55f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c279b expref: 30 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.961445:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774000/0x26940258de8ef574 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c279b expref: 29 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.961453:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:2.0:1789776546.961455:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789776546.961458:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8686774000, rc 0) 00000100:00100000:2.0:1789776546.962082:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+29:10408:x1876716462051328:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 2118us (2782us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1789776546.962105:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 62 00000100:00100000:1.0:1789776546.968953:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776546.969043:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776546.969242:0:11142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462051584 00000100:00100000:3.0:1789776546.969256:0:11142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462051584 00000100:00100000:3.0:1789776546.969389:0:11142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4 00000100:00100000:3.0:1789776546.969403:0:11142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0795fb8a-e14a-4768-806c-f332ad101de7+29:2356:x1876716462051584:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789776546.969425:0:11142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776546.969465:0:11142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774000/0x26940258de8ef574 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c279b expref: 29 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776546.969491:0:11142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:3.0:1789776546.969519:0:11142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776546.969614:0:11142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0795fb8a-e14a-4768-806c-f332ad101de7+28:2356:x1876716462051584:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 214us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776546.969622:0:11142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4 00000100:00100000:2.0:1789776546.969926:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462051456 00000100:00100000:2.0:1789776546.969932:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462051456 00000100:00100000:2.0:1789776546.969971:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 63 00000100:00100000:2.0:1789776546.969979:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+28:10408:x1876716462051456:12345-192.168.202.6@tcp:54:lfs.0 00010000:00010000:2.0:1789776546.970061:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8ef582 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.970079:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8ef582 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.970105:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8ef582 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.970148:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8ef582 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.970155:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8ef582 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.970173:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8ef582 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.970181:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8686775200 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776546.970186:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8ef582 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.970195:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8ef582 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.970206:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:2.0:1789776546.970209:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789776546.970213:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8ef582 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776546.970242:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8ef582 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776546.970291:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+28:10408:x1876716462051456:12345-192.168.202.6@tcp:54:lfs.0 Request processed in 313us (1352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776546.970299:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 63 00000100:00100000:1.0:1789776546.974078:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776546.974197:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462051840 00000100:00100000:0.0:1789776546.974329:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462051840 00000100:00100000:0.0:1789776546.974453:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 17 00000100:00100000:0.0:1789776546.974465:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+28:10408:x1876716462051840:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:0.0:1789776546.975062:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+29:10408:x1876716462051840:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 596us (1001us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1789776546.975096:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 17 00000100:00100000:1.0:1789776547.128491:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776547.128646:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462052096 00000100:00100000:0.0:1789776547.128662:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462052096 00000100:00100000:0.0:1789776547.128781:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 64 00000100:00100000:0.0:1789776547.128795:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+29:10426:x1876716462052096:12345-192.168.202.6@tcp:101:cat.0 00010000:00010000:0.0:1789776547.128840:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776547.128871:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8ef589 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c27a2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.129016:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef590 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.129037:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef590 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.129052:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef590 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776547.129068:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789776547.129327:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8ef589 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27a2 expref: 32 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.129352:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef590 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27a2 expref: 31 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.129363:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:0.0:1789776547.129366:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789776547.129371:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86b9b08e00, rc 0) 00000100:00100000:0.0:1789776547.129491:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+31:10426:x1876716462052096:12345-192.168.202.6@tcp:101:cat.0 Request processed in 699us (1020us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1789776547.129500:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 64 00000100:00080000:3.0:1789776547.130062:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789776547.166300:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776547.166497:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462052224 00000100:00100000:2.0:1789776547.166512:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462052224 00000100:00100000:2.0:1789776547.166593:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 65 00000100:00100000:2.0:1789776547.166607:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+31:10427:x1876716462052224:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1789776547.166644:0:8177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776547.166677:0:8177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8ef59e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c27a9 expref: -99 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.166818:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774c00/0x26940258de8ef5a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.166836:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774c00/0x26940258de8ef5a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.166849:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774c00/0x26940258de8ef5a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776547.166894:0:8177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1789776547.166899:0:8177:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789776547.166921:0:8177:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774c00/0x26940258de8ef5a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.166953:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8ef59e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27a9 expref: 33 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.166974:0:8177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774c00/0x26940258de8ef5a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27a9 expref: 32 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.166984:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c8682cbe900) 00010000:00010000:2.0:1789776547.166987:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789776547.166991:0:8177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8686774c00, rc 0) 00000100:00100000:2.0:1789776547.167084:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+32:10427:x1876716462052224:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 480us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776547.167349:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 65 00000100:00100000:1.0:1789776547.173120:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776547.173256:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462052608 00000100:00100000:2.0:1789776547.173269:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462052608 00000100:00100000:2.0:1789776547.173362:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 18 00000100:00100000:2.0:1789776547.173381:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+32:10427:x1876716462052608:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:2.0:1789776547.173816:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+33:10427:x1876716462052608:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 436us (727us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1789776547.173825:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 18 00000100:00100000:3.0:1789776547.176898:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776547.177372:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462052736 00000100:00100000:1.0:1789776547.177388:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462052736 00000100:00100000:1.0:1789776547.177480:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5 00000100:00100000:1.0:1789776547.177493:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0795fb8a-e14a-4768-806c-f332ad101de7+33:10427:x1876716462052736:12345-192.168.202.6@tcp:103:lfs.0 00010000:00010000:1.0:1789776547.177516:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789776547.177556:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775800/0x26940258de8ef535 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c278d expref: 33 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.177589:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef590 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27a2 expref: 32 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.177602:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef439 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c274e expref: 31 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.177619:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:1.0:1789776547.177633:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776547.177725:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0795fb8a-e14a-4768-806c-f332ad101de7+30:10427:x1876716462052736:12345-192.168.202.6@tcp:103:lfs.0 Request processed in 235us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776547.177734:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5 00000100:00100000:1.0:1789776547.188592:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776547.188855:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462052864 00000100:00100000:0.0:1789776547.188869:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462052864 00000100:00100000:0.0:1789776547.188950:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 66 00000100:00100000:0.0:1789776547.188962:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9def100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+30:10427:x1876716462052864:12345-192.168.202.6@tcp:58:lfs.0 00010000:00010000:0.0:1789776547.189169:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8ef5ac lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.189191:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8ef5ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.189205:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8ef5ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789776547.190017:0:5811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789776547.190322:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1789776547.190406:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1789776547.190580:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9def100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+30:10427:x1876716462052864:12345-192.168.202.6@tcp:58:lfs.0 Request processed in 1614us (2002us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776547.190592:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 66 00000100:00100000:2.0:1789776547.211997:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776547.212209:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462052992 00000100:00100000:3.0:1789776547.212285:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462052992 00000100:00100000:3.0:1789776547.212383:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 67 00000100:00100000:3.0:1789776547.212398:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+30:10429:x1876716462052992:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1789776547.212433:0:8177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776547.212462:0:8177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef5b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c27b0 expref: -99 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776547.212565:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef5ba lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776547.212586:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef5ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776547.212601:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef5ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776547.212620:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef5c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776547.212627:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef5c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776547.212632:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef5c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.213585:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775a00/0x26940258de8ef5c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.213602:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775a00/0x26940258de8ef5c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.213615:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775a00/0x26940258de8ef5c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776547.213666:0:8177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789776547.213671:0:8177:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789776547.213697:0:8177:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775a00/0x26940258de8ef5c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.213711:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775a00/0x26940258de8ef5c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.213721:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef5ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.213729:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef5ba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.213737:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef5ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.213756:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86829e1200 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776547.214933:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef5ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.214962:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef5ba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.214985:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c8682cbe900) 00010000:00010000:2.0:1789776547.214988:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776547.214995:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef5ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.215003:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef5ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.215034:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef5c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.215042:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef5c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.215049:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef5c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.215056:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86829e0e00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776547.215059:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef5c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.215065:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef5c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.215524:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c8682cbe800) 00010000:00010000:2.0:1789776547.215527:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776547.215532:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef5c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.215539:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef5c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.215613:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef5b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27b0 expref: 32 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.215630:0:8177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775a00/0x26940258de8ef5c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27b0 expref: 31 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.215639:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c86a08df900) 00010000:00010000:2.0:1789776547.215642:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789776547.215645:0:8177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8686775a00, rc 0) 00000100:00100000:2.0:1789776547.215759:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+31:10429:x1876716462052992:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 3362us (3781us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776547.215777:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 67 00000040:00080000:3.0:1789776547.284649:0:11658:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789776547.284665:0:11658:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789776547.284738:0:11658:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789776547.284749:0:11658:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789776547.284971:0:11658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a01dca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11658:1876716471517312:192.168.202.6@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789776547.285135:0:11658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8582caed80 going to sleep for 11 seconds 00000100:00100000:3.0:1789776547.292350:0:11658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a01dca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11658:1876716471517312:192.168.202.6@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789776547.292702:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776547.293414:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462053120 00000100:00100000:3.0:1789776547.293426:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462053120 00000100:00100000:3.0:1789776547.293504:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1 00000100:00100000:3.0:1789776547.293516:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0795fb8a-e14a-4768-806c-f332ad101de7+31:10440:x1876716462053120:12345-192.168.202.6@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1789776547.293679:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0795fb8a-e14a-4768-806c-f332ad101de7+31:10440:x1876716462053120:12345-192.168.202.6@tcp:900:lhsmtool_posix.0 Request processed in 163us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776547.293688:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1 00000100:00100000:2.0:1789776547.316151:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776547.316309:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462053248 00000100:00100000:0.0:1789776547.316324:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462053248 00000100:00100000:0.0:1789776547.316391:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 68 00000100:00100000:0.0:1789776547.316404:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+31:10440:x1876716462053248:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789776547.316446:0:5811:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789776547.316615:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+31:10440:x1876716462053248:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 Request processed in 213us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776547.316633:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 68 00000100:00100000:1.0:1789776547.329100:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776547.332034:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462053376 00000100:00100000:0.0:1789776547.332069:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462053376 00000100:00100000:0.0:1789776547.334413:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 69 00000100:00100000:0.0:1789776547.334434:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9ded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+31:10440:x1876716462053376:12345-192.168.202.6@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789776547.334538:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef5cf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.334559:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef5cf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.334578:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef5cf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.334597:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09400/0x26940258de8ef5d6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.334603:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09400/0x26940258de8ef5d6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.334609:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09400/0x26940258de8ef5d6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.334642:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09600/0x26940258de8ef5dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.334651:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09600/0x26940258de8ef5dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.334658:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09600/0x26940258de8ef5dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776547.334722:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789776547.334728:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789776547.334745:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09600/0x26940258de8ef5dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.334760:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef5cf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.334767:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef5cf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.334774:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef5cf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.334780:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b08400 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776547.334785:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef5cf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.334793:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef5cf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.336291:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c8683789100) 00010000:00010000:0.0:1789776547.336303:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776547.336312:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef5cf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.336323:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef5cf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.336347:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09400/0x26940258de8ef5d6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.336371:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09400/0x26940258de8ef5d6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.336378:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09400/0x26940258de8ef5d6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.336384:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b09400 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776547.336388:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09400/0x26940258de8ef5d6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.336395:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09400/0x26940258de8ef5d6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.336404:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9c86a08dfa00) 00010000:00010000:0.0:1789776547.336407:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776547.336411:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09400/0x26940258de8ef5d6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.336417:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09400/0x26940258de8ef5d6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.336439:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09600/0x26940258de8ef5dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.336445:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09600/0x26940258de8ef5dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.336451:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09600/0x26940258de8ef5dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.336455:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b09600 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776547.336463:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09600/0x26940258de8ef5dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.336469:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09600/0x26940258de8ef5dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.336477:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c86a08df900) 00010000:00010000:0.0:1789776547.336480:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776547.336483:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09600/0x26940258de8ef5dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.336489:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09600/0x26940258de8ef5dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776547.336613:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9ded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+31:10440:x1876716462053376:12345-192.168.202.6@tcp:34:lhsmtool_posix.0 Request processed in 2179us (7534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776547.336625:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 69 00000100:00100000:0.0:1789776547.340308:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776547.340946:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462053632 00000100:00100000:1.0:1789776547.340961:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462053632 00000100:00100000:1.0:1789776547.341062:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 70 00000100:00100000:1.0:1789776547.341075:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8689394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+31:10440:x1876716462053632:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789776547.341144:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776547.341181:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8ef5e4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c27b7 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.341363:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef5eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.341383:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef5eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.341398:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef5eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776547.341412:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789776547.341545:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef5eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.341554:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef5eb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.341562:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef5eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.341569:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5cb400 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776547.341575:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef5eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.341584:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef5eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.341599:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c86a08df900) 00010000:00010000:1.0:1789776547.341611:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789776547.341618:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef5eb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.341624:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef5eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.341676:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8ef5e4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27b7 expref: 33 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.341688:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c8683789100) 00010000:00010000:1.0:1789776547.341690:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789776547.341694:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8ef5e4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27b7 expref: 33 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.341704:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86bf5cae00, rc 0) 00000100:00100000:1.0:1789776547.341791:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8689394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+32:10440:x1876716462053632:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 719us (1758us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1789776547.343103:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 70 00000100:00100000:1.0:1789776547.353125:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776547.353591:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462053760 00000100:00100000:0.0:1789776547.353605:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462053760 00000100:00100000:0.0:1789776547.353687:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 71 00000100:00100000:0.0:1789776547.353699:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+32:10440:x1876716462053760:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789776547.353769:0:8177:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789776547.353919:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+32:10440:x1876716462053760:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 Request processed in 222us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776547.353928:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 71 00000100:00100000:0.0:1789776547.357956:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776547.358382:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462054016 00000100:00100000:1.0:1789776547.358396:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462054016 00000100:00100000:1.0:1789776547.358477:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 72 00000100:00100000:1.0:1789776547.358490:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8689396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+32:10440:x1876716462054016:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789776547.358520:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776547.358525:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789776547.358562:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774c00/0x26940258de8ef5a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27a9 expref: 32 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.358598:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c8682cbe900) 00010000:00010000:1.0:1789776547.358603:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789776547.358618:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8ef5f9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c27be expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789776547.359543:0:5811:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1789776547.361940:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef600 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.361972:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef600 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.361989:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef600 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.362193:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8ef5f9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27be expref: 34 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.362230:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef600 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27be expref: 33 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.362241:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c8683789d00) 00010000:00010000:1.0:1789776547.362244:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789776547.362248:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86bf5cb400, rc 0) 00000100:00100000:1.0:1789776547.364202:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8689396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+33:10440:x1876716462054016:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 5697us (6242us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1789776547.364230:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 72 00000100:00100000:1.0:1789776547.378624:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776547.378903:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462054272 00000100:00100000:0.0:1789776547.378919:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462054272 00000100:00100000:0.0:1789776547.379012:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 73 00000100:00100000:0.0:1789776547.379026:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+33:10440:x1876716462054272:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789776547.379317:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776547.379355:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef600 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27be expref: 33 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.379381:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c8683789d00) 00010000:00010000:0.0:1789776547.379402:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789776547.379434:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09400/0x26940258de8ef60e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.379451:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09400/0x26940258de8ef60e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.379464:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09400/0x26940258de8ef60e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.379483:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef615 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xb855c8d3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.379490:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef615 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb855c8d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.379497:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef615 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb855c8d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.379770:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09400/0x26940258de8ef60e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.379779:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09400/0x26940258de8ef60e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.379797:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09400/0x26940258de8ef60e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.385139:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b09400 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776547.385149:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09400/0x26940258de8ef60e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.385163:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09400/0x26940258de8ef60e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.385188:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c8682cbe900) 00010000:00010000:0.0:1789776547.385192:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776547.385199:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09400/0x26940258de8ef60e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.385209:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09400/0x26940258de8ef60e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.385251:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef615 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb855c8d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.385259:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef615 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb855c8d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.385266:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef615 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb855c8d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.385271:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b08400 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776547.385275:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef615 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb855c8d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.385295:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef615 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb855c8d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.385304:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xb855c8d3 (ffff9c86a08dfa00) 00010000:00010000:0.0:1789776547.385307:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776547.385311:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef615 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xb855c8d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.385317:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef615 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xb855c8d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776547.385486:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+32:10440:x1876716462054272:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 Request processed in 6455us (6867us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789776547.385498:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 73 00000100:00100000:0.0:1789776547.393448:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776547.395098:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462054400 00000100:00100000:1.0:1789776547.395130:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462054400 00000100:00100000:1.0:1789776547.395255:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 74 00000100:00100000:1.0:1789776547.395269:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8689395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+32:10440:x1876716462054400:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789776547.395297:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776547.395328:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8ef61c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c27c5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.395378:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef623 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.395397:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef623 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.395413:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef623 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.395546:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8ef61c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27c5 expref: 34 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.395569:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef623 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27c5 expref: 33 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.395580:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c8683789e00) 00010000:00010000:1.0:1789776547.395583:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789776547.395588:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86bf5ca400, rc 0) 00000100:00100000:1.0:1789776547.395683:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8689395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+33:10440:x1876716462054400:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 417us (2250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776547.395703:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 74 00000100:00100000:1.0:1789776547.401542:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776547.404997:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462054656 00000100:00100000:0.0:1789776547.405019:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462054656 00000100:00100000:1.0:1789776547.408201:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 75 00000100:00100000:1.0:1789776547.408250:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+33:10440:x1876716462054656:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789776547.408379:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8ef62a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.408404:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8ef62a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.408419:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8ef62a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789776547.408872:0:8177:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1789776547.408885:0:8177:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 300188667453ns, next at 301188664024ns, rc = 0 00000004:00010000:1.0:1789776547.409004:0:8177:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000008f5b405 reply state 00000000f9d8472e transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8ef62a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776547.409017:0:8177:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789776547.409183:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+35:10440:x1876716462054656:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 Request processed in 964us (7656us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1789776547.409191:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 75 00010000:00010000:0.0:1789776547.415149:0:3259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8ef62a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.415175:0:3259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8ef62a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.415184:0:3259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8ef62a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.415191:0:3259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5cae00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776547.415197:0:3259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8ef62a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.415263:0:3259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8ef62a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.415284:0:3259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c8683789e00) 00010000:00010000:0.0:1789776547.415287:0:3259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789776547.415293:0:3259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8ef62a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.415299:0:3259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8ef62a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776547.423637:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776547.423820:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462054784 00000100:00100000:2.0:1789776547.423834:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462054784 00000100:00100000:2.0:1789776547.423923:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 76 00000100:00100000:2.0:1789776547.423936:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8689397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+34:10440:x1876716462054784:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789776547.423974:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776547.424006:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8ef631 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c27cc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.424105:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8ef631 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27cc expref: 35 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.424154:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8ef631 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27cc expref: 35 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.424181:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c8683789e00) 00010000:00010000:2.0:1789776547.424184:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789776547.424188:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8686775c00, rc 0) 00000100:00100000:2.0:1789776547.424312:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8689397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+35:10440:x1876716462054784:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 378us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776547.424320:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 76 00000100:00100000:0.0:1789776547.429171:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776547.429290:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462054912 00000100:00100000:2.0:1789776547.429305:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462054912 00000100:00100000:2.0:1789776547.430333:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 25 00000100:00100000:2.0:1789776547.430346:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8689396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1876716462054912:12345-192.168.202.6@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1789776547.430391:0:6662:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 0795fb8a-e14a-4768-806c-f332ad101de7@192.168.202.6@tcp t0 exp 0000000000000000 cur 300 last 0 00000020:00000080:2.0:1789776547.430434:0:6662:0:(genops.c:1385:class_connect()) connect: client 0795fb8a-e14a-4768-806c-f332ad101de7, cookie 0x26940258de8ef638 00002000:00100000:2.0:1789776547.430450:0:6662:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0795fb8a-e14a-4768-806c-f332ad101de7/ffff9c8689380800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789776547.430482:0:6662:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789776547.430777:0:6662:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789776547.430819:0:6662:0:(import.c:65:import_set_state_nolock()) ffff9c8689380000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789776547.430923:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8689396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0795fb8a-e14a-4768-806c-f332ad101de7+6:2353:x1876716462054912:12345-192.168.202.6@tcp:8:lhsmtool_posix.0 Request processed in 577us (1767us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776547.430946:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 25 00000100:00100000:2.0:1789776547.435936:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776547.436015:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462055040 00000100:00100000:3.0:1789776547.436029:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462055040 00000100:00100000:3.0:1789776547.436138:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 26 00000100:00100000:3.0:1789776547.436151:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0795fb8a-e14a-4768-806c-f332ad101de7+6:0:x1876716462055040:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1789776547.436753:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1789776547.535327:0:6684:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0795fb8a-e14a-4768-806c-f332ad101de7 00000001:00080000:0.0:1789776547.535355:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:3.0:1789776547.535716:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0795fb8a-e14a-4768-806c-f332ad101de7+5:0:x1876716462055040:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 Request processed in 99558us (99907us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789776547.535731:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 26 00000100:00100000:1.0:1789776547.545013:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776547.545639:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462055296 00000100:00100000:2.0:1789776547.545653:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462055296 00000100:00100000:2.0:1789776547.545731:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 19 00000100:00100000:2.0:1789776547.545744:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+35:10440:x1876716462055296:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789776547.548252:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+36:10440:x1876716462055296:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 Request processed in 2496us (3243us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1789776547.548268:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 19 00000100:00100000:0.0:1789776547.564744:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776547.570664:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462055552 00000100:00100000:1.0:1789776547.570690:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462055552 00000100:00100000:0.0:1789776547.575000:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 77 00000100:00100000:0.0:1789776547.575042:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8689395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+36:10440:x1876716462055552:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789776547.575314:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8689395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+36:10440:x1876716462055552:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 295us (10585us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776547.575324:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 77 00000100:00100000:0.0:1789776547.580473:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776547.590403:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462055680 00000100:00100000:2.0:1789776547.590426:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462055680 00000100:00100000:2.0:1789776547.591785:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 78 00000100:00100000:2.0:1789776547.591818:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8689397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+36:10440:x1876716462055680:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789776547.591850:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776547.591880:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774600/0x26940258de8ef63f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c27d3 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.591977:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8ef646 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.591996:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8ef646 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.592010:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8ef646 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776547.592073:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789776547.592096:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8ef646 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.592138:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774600/0x26940258de8ef63f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27d3 expref: 38 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.592158:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8ef646 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27d3 expref: 37 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.592168:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c8683789e00) 00010000:00010000:2.0:1789776547.592171:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789776547.592175:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8686774200, rc 0) 00000100:00100000:2.0:1789776547.592286:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8689397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+37:10440:x1876716462055680:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 487us (11830us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776547.592293:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 78 00000100:00100000:1.0:1789776547.597782:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776547.597946:0:8384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462055808 00000100:00100000:0.0:1789776547.597959:0:8384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462055808 00000100:00100000:0.0:1789776547.598045:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 27 00000100:00100000:0.0:1789776547.598058:0:8384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0795fb8a-e14a-4768-806c-f332ad101de7+5:2354:x1876716462055808:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789776547.598085:0:8384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776547.598135:0:8384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095df49cb/0x26940258de8ef64d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c27da expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789776547.598171:0:8384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aadd2a4, blocks: 0x1 00010000:00010000:0.0:1789776547.598197:0:8384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=300s v=(0 0) 00010000:00010000:0.0:1789776547.598202:0:8384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789776547.598246:0:8384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095df49cb/0x26940258de8ef64d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27da expref: 6 pid: 8384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.598271:0:8384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000095df49cb/0x26940258de8ef64d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27da expref: 6 pid: 8384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.598288:0:8384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86b9b09a00, rc 0) 00000100:00100000:0.0:1789776547.598362:0:8384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0795fb8a-e14a-4768-806c-f332ad101de7+6:2354:x1876716462055808:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 307us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776547.598370:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 27 00000100:00100000:1.0:1789776547.604381:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776547.604497:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462056064 00000100:00100000:3.0:1789776547.604512:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462056064 00000100:00100000:3.0:1789776547.604600:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 79 00000100:00100000:3.0:1789776547.604624:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+37:10440:x1876716462056064:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789776547.604773:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+37:10440:x1876716462056064:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 151us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776547.604781:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 79 00000100:00100000:1.0:1789776547.612057:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776547.612188:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462056192 00000100:00100000:0.0:1789776547.612203:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462056192 00000100:00100000:0.0:1789776547.612657:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 28 00000100:00100000:0.0:1789776547.612670:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+6:10440:x1876716462056192:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789776547.612696:0:6661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776547.612719:0:6661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065064d00/0x26940258de8ef654 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c27e1 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.612776:0:6661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000095df49cb/0x26940258de8ef64d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27da expref: 7 pid: 8384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.612806:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789776547.612812:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789776547.612819:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065064d00/0x26940258de8ef654 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27e1 expref: 7 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.612862:0:6661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000095df49cb/0x26940258de8ef64d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27da expref: 7 pid: 8384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.612877:0:6661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000095df49cb/0x26940258de8ef64d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27da expref: 7 pid: 8384 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776547.612895:0:6661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c8689394000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6661:1876716471517440:192.168.202.6@tcp:104: 00000100:00100000:0.0:1789776547.613010:0:6661:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86a00da840 going to sleep for 11 seconds 00000100:00100000:1.0:1789776547.626297:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776547.626355:0:11144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462056320 00000100:00100000:1.0:1789776547.626369:0:11144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462056320 00010000:00010000:1.0:1789776547.626423:0:11144:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000095df49cb/0x26940258de8ef64d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27da expref: 8 pid: 8384 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776547.626471:0:11144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 42 00000100:00100000:1.0:1789776547.626483:0:11144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c869880d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0795fb8a-e14a-4768-806c-f332ad101de7+8:2356:x1876716462056320:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776547.626523:0:11144:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776547.626558:0:11144:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000095df49cb/0x26940258de8ef64d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27da expref: 8 pid: 8384 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.626576:0:11144:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000095df49cb/0x26940258de8ef64d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27da expref: 8 pid: 8384 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.626611:0:11144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776547.626617:0:11144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776547.626627:0:11144:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065064d00/0x26940258de8ef654 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27e1 expref: 8 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.626639:0:11144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065064d00/0x26940258de8ef654 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27e1 expref: 8 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.626688:0:11144:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000065064d00/0x26940258de8ef654 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27e1 expref: 8 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776547.626706:0:11144:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7be680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:11144:1876716471517568:192.168.202.6@tcp:105: 00000100:00100000:1.0:1789776547.626819:0:11144:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bc8f63c0 going to sleep for 11 seconds 00010000:00010000:3.0:1789776547.633161:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095df49cb/0x26940258de8ef64d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27da expref: 8 pid: 8384 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776547.633203:0:6661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c8689394000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6661:1876716471517440:192.168.202.6@tcp:104: 00010000:00010000:3.0:1789776547.633827:0:6661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065064d00/0x26940258de8ef654 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27e1 expref: 7 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776547.633849:0:6661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86b9b08c00, rc 0) 00000100:00100000:1.0:1789776547.634460:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+7:10440:x1876716462056192:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 21786us (22411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776547.634471:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 28 00000100:00100000:3.0:1789776547.638840:0:11144:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7be680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:11144:1876716471517568:192.168.202.6@tcp:105: 00010000:00010000:3.0:1789776547.638880:0:11144:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776547.638966:0:11144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c869880d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0795fb8a-e14a-4768-806c-f332ad101de7+6:2356:x1876716462056320:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 12484us (12685us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776547.638979:0:11144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 42 00000100:00100000:2.0:1789776547.642463:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776547.643691:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462056448 00000100:00100000:0.0:1789776547.643709:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462056448 00002000:00100000:0.0:1789776547.643790:0:6667:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9c86bf299180 x1876716462056448/t0(0) o4->0795fb8a-e14a-4768-806c-f332ad101de7@192.168.202.6@tcp:738/0 lens 504/0 e 0 to 0 dl 1789776558 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789776547.643810:0:6667:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c86bf299180 with x1876716462056448 ext(0->8) 00002000:00010000:0.0:1789776547.643818:0:6667:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c86bf299180 00000100:00100000:0.0:1789776547.643860:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 0 00000100:00100000:0.0:1789776547.643873:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf299180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0795fb8a-e14a-4768-806c-f332ad101de7+6:2356:x1876716462056448:12345-192.168.202.6@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789776547.647907:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf299180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0795fb8a-e14a-4768-806c-f332ad101de7+8:2356:x1876716462056448:12345-192.168.202.6@tcp:4:lhsmtool_posix.0 Request processed in 4028us (5453us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789776547.647934:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 0 00002000:00100000:0.0:1789776547.647948:0:6667:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9c86bf299180 x1876716462056448/t4294967302(0) o4->0795fb8a-e14a-4768-806c-f332ad101de7@192.168.202.6@tcp:738/0 lens 504/448 e 0 to 0 dl 1789776558 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789776547.647960:0:6667:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c86bf299180 with x1876716462056448 ext(0->8) 00002000:00010000:0.0:1789776547.647968:0:6667:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c86bf299180 00000100:00100000:0.0:1789776547.663024:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776547.663118:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462056576 00000100:00100000:2.0:1789776547.663133:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462056576 00000100:00100000:2.0:1789776547.663404:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 80 00000100:00100000:2.0:1789776547.663420:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8689396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+37:10440:x1876716462056576:12345-192.168.202.6@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1789776547.702996:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8689396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+37:10440:x1876716462056576:12345-192.168.202.6@tcp:44:lhsmtool_posix.0 Request processed in 39561us (39968us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776547.703016:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 80 00000001:00080000:1.0:1789776547.703082:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967349 is committed 00000001:00080000:1.0:1789776547.703102:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:1.0:1789776547.703117:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000001:00080000:1.0:1789776547.703147:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:1.0:1789776547.703189:0:5833:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:0.0:1789776547.703697:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c8689394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471517696:0@lo:2:osp-syn-0-0.0 00000020:00080000:1.0:1789776547.703763:0:5844:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1789776547.703778:0:5844:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1789776547.703783:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776547.703872:0:8384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471517696 00000100:00100000:0.0:1789776547.703882:0:8384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471517696 00000100:00080000:1.0:1789776547.703963:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789776547.703968:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789776547.703981:0:8384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8689395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471517696:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1789776547.704610:0:8384:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789776547.704615:0:8384:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789776548 00002000:00010000:0.0:1789776547.704617:0:8384:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789776547.704620:0:8384:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789776548 -> 1789776548 00002000:00010000:0.0:1789776547.704623:0:8384:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789776547.704693:0:8384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8689395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3276:x1876716471517696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 713us (909us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1789776547.704702:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:1.0:1789776547.704998:0:3276:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c8689394380/2, rc 0, transno 4294967303 00000100:00100000:1.0:1789776547.705007:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c8689394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471517696:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789776547.708255:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776547.708482:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462056704 00000100:00100000:3.0:1789776547.708497:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462056704 00000100:00100000:3.0:1789776547.708924:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 30 00000100:00100000:3.0:1789776547.708939:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8689396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0795fb8a-e14a-4768-806c-f332ad101de7+8:2357:x1876716462056704:12345-192.168.202.6@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1789776547.747952:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789776547.756040:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:0.0:1789776547.756077:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:3.0:1789776547.757207:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8689396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0795fb8a-e14a-4768-806c-f332ad101de7+6:2357:x1876716462056704:12345-192.168.202.6@tcp:16:lhsmtool_posix.0 Request processed in 47928us (48653us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776547.757333:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 30 00000100:00100000:3.0:1789776547.765448:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776547.765607:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462056960 00000100:00100000:1.0:1789776547.765624:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462056960 00000100:00100000:1.0:1789776547.765703:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 81 00000100:00100000:1.0:1789776547.765716:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+13:10440:x1876716462056960:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789776547.765794:0:8177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776547.765834:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8ef646 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27d3 expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.765856:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c8683789e00) 00010000:00010000:1.0:1789776547.765994:0:8177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789776547.766060:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef65b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.766079:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef65b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.766092:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef65b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789776547.766853:0:8177:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000076c7f54 reply state 00000000072ea253 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef65b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776547.767009:0:8177:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789776547.767182:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+14:10440:x1876716462056960:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 Request processed in 1463us (1745us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1789776547.767195:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 81 00010000:00010000:2.0:1789776547.773254:0:3260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef65b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.773277:0:3260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef65b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.773286:0:3260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef65b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.773302:0:3260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5caa00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776547.773308:0:3260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef65b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.773317:0:3260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef65b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.773339:0:3260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c8683789e00) 00010000:00010000:2.0:1789776547.773343:0:3260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776547.773350:0:3260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef65b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.773356:0:3260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef65b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776547.773687:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776547.774734:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462057088 00000100:00100000:2.0:1789776547.774759:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462057088 00000100:00100000:2.0:1789776547.774839:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 31 00000100:00100000:2.0:1789776547.774852:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0795fb8a-e14a-4768-806c-f332ad101de7+6:2356:x1876716462057088:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789776547.775204:0:6662:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1789776547.775209:0:6662:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1789776548 -> 1789776547 00002000:00010000:2.0:1789776547.775213:0:6662:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789776545 00002000:00010000:2.0:1789776547.775238:0:6662:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789776548 -> 1789776547 00002000:00010000:2.0:1789776547.775241:0:6662:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1789776547.775331:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0795fb8a-e14a-4768-806c-f332ad101de7+7:2356:x1876716462057088:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 Request processed in 481us (1648us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789776547.775340:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 31 00000100:00100000:1.0:1789776547.785913:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776547.785960:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462057344 00000100:00100000:3.0:1789776547.785974:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462057344 00000100:00100000:3.0:1789776547.786047:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 82 00000100:00100000:3.0:1789776547.786073:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+13:10440:x1876716462057344:12345-192.168.202.6@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789776547.786179:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef662 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776547.786204:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef623 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27c5 expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776547.786442:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef662 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776547.786500:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef623 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27c5 expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776547.786519:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef623 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27c5 expref: 13 pid: 5813 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776547.786537:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a01dca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1876716471517824:192.168.202.6@tcp:104: 00000100:00100000:3.0:1789776547.786671:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8682e95f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789776547.789180:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776547.790065:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a01dca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1876716471517824:192.168.202.6@tcp:104: 00010000:00010000:1.0:1789776547.790103:0:5813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef662 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776547.790409:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462057472 00000100:00100000:1.0:1789776547.790419:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462057472 00010000:00010000:1.0:1789776547.790467:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef623 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27c5 expref: 14 pid: 5813 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776547.790509:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 43 00000100:00100000:1.0:1789776547.790520:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0795fb8a-e14a-4768-806c-f332ad101de7+14:2356:x1876716462057472:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776547.790538:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776547.790565:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef623 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27c5 expref: 14 pid: 5813 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.790591:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef623 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27c5 expref: 14 pid: 5813 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.790620:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef623 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27c5 expref: 14 pid: 5813 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.790638:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c8683789e00) 00010000:00010000:1.0:1789776547.790644:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef662 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.790655:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef662 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.790663:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef662 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.790697:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776547.790788:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0795fb8a-e14a-4768-806c-f332ad101de7+13:2356:x1876716462057472:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 268us (1621us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776547.790806:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 43 00010000:00010000:3.0:1789776547.790807:0:5813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef662 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776547.790818:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef662 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776547.790865:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef662 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776547.790874:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef662 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776547.790881:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef662 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776547.790889:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86829e0400 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776547.790894:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef662 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776547.790903:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef662 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776547.790913:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c8683789e00) 00010000:00010000:3.0:1789776547.790917:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789776547.790920:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef662 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776547.790926:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef662 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776547.790980:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+12:10440:x1876716462057344:12345-192.168.202.6@tcp:55:lhsmtool_posix.0 Request processed in 4911us (5079us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789776547.790990:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 82 00000100:00100000:1.0:1789776547.794144:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776547.794688:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462057600 00000100:00100000:2.0:1789776547.794714:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462057600 00000100:00100000:2.0:1789776547.794832:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 32 00000100:00100000:2.0:1789776547.794846:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+7:2357:x1876716462057600:12345-192.168.202.6@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789776547.794919:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005144c944/0x26940258de8ef669 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.794949:0:6661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065064d00/0x26940258de8ef654 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27e1 expref: 7 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.794960:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776547.794965:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789776547.794970:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005144c944/0x26940258de8ef669 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.795024:0:6661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000065064d00/0x26940258de8ef654 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27e1 expref: 7 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.795042:0:6661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000065064d00/0x26940258de8ef654 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27e1 expref: 7 pid: 6661 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776547.795076:0:6661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf298000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6661:1876716471517952:192.168.202.6@tcp:104: 00000100:00100000:2.0:1789776547.795210:0:6661:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86903e6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789776547.798697:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776547.798776:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462057728 00000100:00100000:0.0:1789776547.798790:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462057728 00000100:00100000:3.0:1789776547.799012:0:6661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf298000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6661:1876716471517952:192.168.202.6@tcp:104: 00010000:00010000:3.0:1789776547.799046:0:6661:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005144c944/0x26940258de8ef669 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.799315:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000065064d00/0x26940258de8ef654 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27e1 expref: 8 pid: 6661 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776547.799962:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 44 00000100:00100000:0.0:1789776547.799977:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf298380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0795fb8a-e14a-4768-806c-f332ad101de7+8:2357:x1876716462057728:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789776547.800003:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776547.800037:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000065064d00/0x26940258de8ef654 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27e1 expref: 8 pid: 6661 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.800054:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000065064d00/0x26940258de8ef654 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27e1 expref: 8 pid: 6661 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.800083:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065064d00/0x26940258de8ef654 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27e1 expref: 8 pid: 6661 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.800101:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789776547.800105:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789776547.800121:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005144c944/0x26940258de8ef669 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.800134:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005144c944/0x26940258de8ef669 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.800174:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789776547.800249:0:6661:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005144c944/0x26940258de8ef669 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776547.800262:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005144c944/0x26940258de8ef669 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776547.800290:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf298380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0795fb8a-e14a-4768-806c-f332ad101de7+7:2357:x1876716462057728:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 316us (1607us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776547.800299:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 44 00010000:00010000:3.0:1789776547.800307:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005144c944/0x26940258de8ef669 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776547.800318:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005144c944/0x26940258de8ef669 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776547.800327:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005144c944/0x26940258de8ef669 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776547.800335:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8686774800 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:3.0:1789776547.800340:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005144c944/0x26940258de8ef669 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776547.800350:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005144c944/0x26940258de8ef669 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776547.800366:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005144c944/0x26940258de8ef669 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776547.800387:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005144c944/0x26940258de8ef669 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776547.800448:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+6:2357:x1876716462057600:12345-192.168.202.6@tcp:1:lhsmtool_posix.0 Request processed in 5605us (6318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776547.800457:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 32 00000100:00100000:1.0:1789776547.807764:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776547.808014:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462057984 00000100:00100000:3.0:1789776547.808027:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462057984 00000100:00100000:3.0:1789776547.808131:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 83 00000100:00100000:3.0:1789776547.808143:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+12:10440:x1876716462057984:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789776547.808272:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef670 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776547.808308:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef670 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776547.808323:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef670 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776547.808596:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef677 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776547.808609:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8ef631 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27cc expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776547.808618:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef677 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776547.808687:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8ef631 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27cc expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776547.808704:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8ef631 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27cc expref: 13 pid: 5813 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776547.808723:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a01dca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1876716471518080:192.168.202.6@tcp:104: 00000100:00100000:3.0:1789776547.808854:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8682e95d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789776547.819128:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776547.819175:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a01dca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1876716471518080:192.168.202.6@tcp:104: 00010000:00010000:3.0:1789776547.819213:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef677 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776547.819256:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462058112 00000100:00100000:0.0:1789776547.819267:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462058112 00010000:00010000:0.0:1789776547.819318:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8ef631 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27cc expref: 14 pid: 5813 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776547.819363:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 45 00000100:00100000:0.0:1789776547.819374:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf29b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0795fb8a-e14a-4768-806c-f332ad101de7+14:2357:x1876716462058112:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789776547.819391:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776547.819399:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8ef631 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27cc expref: 14 pid: 5813 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.819414:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8ef631 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27cc expref: 14 pid: 5813 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.819443:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8ef631 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27cc expref: 14 pid: 5813 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.819460:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c8683789e00) 00010000:00010000:0.0:1789776547.819466:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef677 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.819477:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef677 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.819486:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef677 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.819511:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776547.819728:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf29b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0795fb8a-e14a-4768-806c-f332ad101de7+13:2357:x1876716462058112:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 353us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776547.819749:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 45 00010000:00010000:3.0:1789776547.819912:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef677 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776547.819921:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef677 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789776547.820186:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1789776547.820387:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1789776547.820440:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1789776547.820556:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a01dca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5812:1876716471518208:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789776547.820787:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776547.820887:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8682e95f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789776547.824155:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471518208 00000100:00100000:0.0:1789776547.824178:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471518208 00000100:00100000:0.0:1789776547.824445:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789776547.824459:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bff62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5812:x1876716471518208:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789776547.824657:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bff62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5812:x1876716471518208:12345-0@lo:1000:mdt00_001.0 Request processed in 202us (3869us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776547.824666:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789776547.825198:0:5812:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1789776547.825206:0:5812:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c8689394380, transno 4294967303 00000100:00100000:3.0:1789776547.825247:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a01dca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5812:1876716471518208:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1789776547.825990:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1789776547.826084:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a01dca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5812:1876716471518336:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789776547.826168:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776547.829563:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471518336 00000100:00100000:3.0:1789776547.829612:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8682e95d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789776547.829713:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471518336 00000100:00100000:1.0:1789776547.829937:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789776547.829953:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5812:x1876716471518336:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789776547.830539:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5812:x1876716471518336:12345-0@lo:1000:mdt00_001.0 Request processed in 588us (4368us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1789776547.830702:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789776547.830938:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a01dca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5812:1876716471518336:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1789776547.830995:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef677 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.831013:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef677 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.831021:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef677 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.831029:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86829e0e00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776547.831035:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef677 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.831044:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef677 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.831066:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c8683789e00) 00010000:00010000:2.0:1789776547.831070:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789776547.831077:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef677 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.831084:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef677 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.831153:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8ef5ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.831160:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8ef5ac lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.831166:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8ef5ac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.831170:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b08a00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776547.831183:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8ef5ac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.831189:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8ef5ac lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.831197:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c86a08df900) 00010000:00010000:2.0:1789776547.831199:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789776547.831202:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8ef5ac lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.831207:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8ef5ac lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.832372:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8ef67e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.832404:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775a00/0x26940258de8ef5c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27b0 expref: 16 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.832416:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8ef67e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.832468:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775a00/0x26940258de8ef5c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27b0 expref: 16 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.832488:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775a00/0x26940258de8ef5c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27b0 expref: 16 pid: 8177 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776547.832505:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf29aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1876716471518464:192.168.202.6@tcp:104: 00000100:00100000:2.0:1789776547.833033:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86903e6300 going to sleep for 11 seconds 00000100:00100000:3.0:1789776547.843833:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776547.843887:0:11142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462058240 00000100:00100000:3.0:1789776547.843900:0:11142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462058240 00010000:00010000:3.0:1789776547.843954:0:11142:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775a00/0x26940258de8ef5c8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27b0 expref: 17 pid: 8177 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776547.844000:0:11142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 46 00000100:00100000:3.0:1789776547.844012:0:11142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0795fb8a-e14a-4768-806c-f332ad101de7+17:2356:x1876716462058240:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789776547.844031:0:11142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776547.844039:0:11142:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775a00/0x26940258de8ef5c8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27b0 expref: 17 pid: 8177 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776547.844055:0:11142:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775a00/0x26940258de8ef5c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27b0 expref: 17 pid: 8177 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776547.844087:0:11142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c86a08df900) 00010000:00010000:3.0:1789776547.844093:0:11142:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8ef67e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776547.844104:0:11142:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8ef67e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776547.844124:0:11142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8ef67e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776547.844166:0:11142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776547.844279:0:11142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0795fb8a-e14a-4768-806c-f332ad101de7+17:2356:x1876716462058240:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 268us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776547.844287:0:11142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 46 00010000:00010000:0.0:1789776547.844747:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775a00/0x26940258de8ef5c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27b0 expref: 16 pid: 8177 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776547.844766:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf29aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1876716471518464:192.168.202.6@tcp:104: 00010000:00010000:0.0:1789776547.844792:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8ef67e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.844802:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8ef67e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.844807:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8ef67e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.844821:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8ef67e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.844828:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8ef67e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.844835:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8ef67e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.844851:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8686775200 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776547.844856:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8ef67e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.844877:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8ef67e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.844891:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c86a08df900) 00010000:00010000:0.0:1789776547.844894:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776547.844898:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8ef67e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.844904:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8ef67e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.844915:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef670 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.844921:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef670 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.844926:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef670 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.844931:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86829e0400 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776547.844933:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef670 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.844939:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef670 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.844956:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c86a08df900) 00010000:00010000:0.0:1789776547.844959:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789776547.844962:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef670 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776547.844969:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef670 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776547.845307:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+15:10440:x1876716462057984:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 37164us (37558us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1789776547.845318:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 83 00000020:00080000:0.0:1789776547.845323:0:5812:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789776547.846446:0:11658:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789776547.846457:0:11658:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789776547.846518:0:11658:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789776547.846526:0:11658:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789776547.850772:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776547.852349:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462058496 00000100:00100000:1.0:1789776547.852369:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462058496 00000100:00100000:1.0:1789776547.852444:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 20 00000100:00100000:1.0:1789776547.852458:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf29a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+15:10440:x1876716462058496:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789776547.857096:0:5814:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789776547.859079:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1789776547.859192:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cba00/0x26940258de8ef685 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.860387:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cba00/0x26940258de8ef685 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.860413:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cba00/0x26940258de8ef685 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.860425:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cba00/0x26940258de8ef685 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.860432:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cba00/0x26940258de8ef685 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.860440:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cba00/0x26940258de8ef685 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776547.860463:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789776547.860758:0:8421:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776547.860768:0:8421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cba00/0x26940258de8ef685 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.860776:0:8421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5cba00 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:2.0:1789776547.860782:0:8421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cba00/0x26940258de8ef685 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.860792:0:8421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cba00/0x26940258de8ef685 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.860808:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c8683789900) 00010000:00010000:2.0:1789776547.860810:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789776547.860818:0:8421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cba00/0x26940258de8ef685 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.860823:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cba00/0x26940258de8ef685 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776547.860850:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776547.860852:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776547.860854:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776547.861450:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf29a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+17:10440:x1876716462058496:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 Request processed in 8986us (10684us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1789776547.861464:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 20 00000020:00080000:1.0:1789776547.861482:0:5814:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:3.0:1789776548.159370:0:11977:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789776548.159386:0:11977:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789776548.159431:0:11977:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789776548.159439:0:11977:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789776548.292775:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776548.292893:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462058752 00000100:00100000:1.0:1789776548.292908:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462058752 00000100:00100000:1.0:1789776548.292992:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 84 00000100:00100000:1.0:1789776548.293005:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+17:10450:x1876716462058752:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1789776548.293038:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776548.293067:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef68c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c27e8 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.293257:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb000/0x26940258de8ef693 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.293278:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb000/0x26940258de8ef693 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.293298:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb000/0x26940258de8ef693 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776548.293314:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1789776548.293487:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef68c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27e8 expref: 20 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.293507:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb000/0x26940258de8ef693 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27e8 expref: 19 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.293518:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c8682cbe900) 00010000:00010000:1.0:1789776548.293521:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789776548.293525:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86bf5cb000, rc 0) 00000100:00100000:1.0:1789776548.293599:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+19:10450:x1876716462058752:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 597us (850us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1789776548.293630:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 84 00000100:00100000:3.0:1789776548.296420:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776548.296553:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462058880 00000100:00100000:1.0:1789776548.296568:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462058880 00000100:00100000:1.0:1789776548.296640:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 85 00000100:00100000:1.0:1789776548.296652:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+19:10450:x1876716462058880:12345-192.168.202.6@tcp:34:lfs.0 00010000:00010000:1.0:1789776548.296760:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8ef6a1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.296795:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8ef6a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.296811:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8ef6a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.296834:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef6a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.296841:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef6a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.296848:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef6a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.297195:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef6af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.297204:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef6af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.297212:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef6af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789776548.297316:0:8177:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef6af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.297334:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8ef6a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.297341:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8ef6a1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.297349:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8ef6a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.297356:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5ca200 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776548.297361:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8ef6a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.297369:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8ef6a1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.297384:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c8682cbe900) 00010000:00010000:1.0:1789776548.297387:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776548.297393:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8ef6a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.297400:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8ef6a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.297414:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef6a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.297420:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef6a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.297433:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef6a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.297438:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5caa00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776548.297441:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef6a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.297448:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef6a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.297456:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c8683789200) 00010000:00010000:1.0:1789776548.297459:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776548.297462:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef6a8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.297467:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef6a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.297493:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef6af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.297499:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef6af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.297505:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef6af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.297510:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5cb600 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776548.297513:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef6af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.297528:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef6af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.297535:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c8683789400) 00010000:00010000:1.0:1789776548.297538:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776548.297540:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef6af lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.297546:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef6af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776548.297933:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+19:10450:x1876716462058880:12345-192.168.202.6@tcp:34:lfs.0 Request processed in 1277us (1526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776548.297945:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 85 00000100:00100000:2.0:1789776548.347173:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776548.347421:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462059136 00000100:00100000:1.0:1789776548.347437:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462059136 00000100:00100000:1.0:1789776548.347521:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 86 00000100:00100000:1.0:1789776548.347535:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf29a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+19:10453:x1876716462059136:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1789776548.347563:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776548.347591:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef6b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c27ef expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.347709:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef6bd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.347730:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef6bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.347744:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef6bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.347788:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8ef6c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.347797:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8ef6c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.347804:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8ef6c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.348174:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef6cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.348185:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef6cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.348193:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef6cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776548.348206:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1789776548.348376:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef6bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.348385:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef6bd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.348392:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef6bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.348399:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5caa00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776548.348404:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef6bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.348424:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef6bd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.348440:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c8682cbe900) 00010000:00010000:1.0:1789776548.348443:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776548.348450:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef6bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.348457:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef6bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.348471:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8ef6c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.348477:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8ef6c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.348482:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8ef6c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.348488:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5ca200 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776548.348490:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8ef6c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.348496:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8ef6c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.348503:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c8683789400) 00010000:00010000:1.0:1789776548.348506:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776548.348509:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8ef6c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.348524:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8ef6c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.348587:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef6b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27ef expref: 22 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.348603:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef6cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27ef expref: 21 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.348610:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c8683789200) 00010000:00010000:1.0:1789776548.348612:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789776548.348615:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86bf5ca400, rc 0) 00000100:00100000:1.0:1789776548.348720:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf29a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+21:10453:x1876716462059136:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 1187us (1565us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1789776548.348729:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 86 00000100:00100000:3.0:1789776548.352427:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776548.352552:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462059264 00000100:00100000:2.0:1789776548.352566:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462059264 00000100:00100000:2.0:1789776548.352645:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 87 00000100:00100000:2.0:1789776548.352658:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bfeb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+21:10453:x1876716462059264:12345-192.168.202.6@tcp:54:lfs.0 00010000:00010000:2.0:1789776548.352788:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774400/0x26940258de8ef6d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776548.352813:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774400/0x26940258de8ef6d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776548.352837:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774400/0x26940258de8ef6d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776548.352872:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774400/0x26940258de8ef6d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776548.352879:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774400/0x26940258de8ef6d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776548.352887:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774400/0x26940258de8ef6d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776548.352894:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8686774400 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776548.352899:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774400/0x26940258de8ef6d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776548.352908:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774400/0x26940258de8ef6d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776548.352923:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c8683789200) 00010000:00010000:2.0:1789776548.352927:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789776548.352933:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774400/0x26940258de8ef6d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776548.352940:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774400/0x26940258de8ef6d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776548.353043:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bfeb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+21:10453:x1876716462059264:12345-192.168.202.6@tcp:54:lfs.0 Request processed in 387us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776548.353052:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 87 00000100:00100000:2.0:1789776548.355344:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776548.355469:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462059520 00000100:00100000:3.0:1789776548.355485:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462059520 00000100:00100000:3.0:1789776548.355552:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 21 00000100:00100000:3.0:1789776548.355563:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a0684050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+21:10453:x1876716462059520:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:3.0:1789776548.355886:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a0684050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+22:10453:x1876716462059520:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 324us (557us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1789776548.355895:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 21 00000100:00100000:2.0:1789776548.398411:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776548.402531:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462059776 00000100:00100000:1.0:1789776548.402554:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462059776 00000100:00100000:1.0:1789776548.402643:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 88 00000100:00100000:1.0:1789776548.402654:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+22:9982:x1876716462059776:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:1.0:1789776548.402691:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776548.402719:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef6e0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c27f6 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.402867:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8ef6e7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.402886:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef6cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27ef expref: 23 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.402909:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8ef6e7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.402956:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef6cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27ef expref: 23 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.402974:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef6cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27ef expref: 23 pid: 5811 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776548.402992:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7bd180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1876716471518592:192.168.202.6@tcp:104: 00000100:00100000:1.0:1789776548.404028:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bc8f6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789776548.409820:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776548.409937:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7bd180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1876716471518592:192.168.202.6@tcp:104: 00010000:00010000:3.0:1789776548.409978:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8ef6e7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776548.410172:0:11143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462059904 00000100:00100000:0.0:1789776548.410182:0:11143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462059904 00010000:00010000:0.0:1789776548.410256:0:11143:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef6cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27ef expref: 24 pid: 5811 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776548.410304:0:11143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 47 00000100:00100000:0.0:1789776548.410316:0:11143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf29a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0795fb8a-e14a-4768-806c-f332ad101de7+24:2357:x1876716462059904:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789776548.410336:0:11143:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776548.410345:0:11143:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef6cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27ef expref: 24 pid: 5811 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.410359:0:11143:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef6cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27ef expref: 24 pid: 5811 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.410401:0:11143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef6cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27ef expref: 24 pid: 5811 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.410429:0:11143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c8683789200) 00010000:00010000:0.0:1789776548.410435:0:11143:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8ef6e7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.410446:0:11143:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8ef6e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.410455:0:11143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8ef6e7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.410491:0:11143:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776548.410561:0:11143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf29a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0795fb8a-e14a-4768-806c-f332ad101de7+23:2357:x1876716462059904:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 248us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776548.410569:0:11143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 47 00010000:00010000:3.0:1789776548.410688:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8ef6e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.410698:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8ef6e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776548.410725:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1789776548.410960:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef6e0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27f6 expref: 24 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.410980:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8ef6e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27f6 expref: 23 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.410988:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c8683789200) 00010000:00010000:3.0:1789776548.410991:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789776548.410994:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86bf5ca200, rc 0) 00000100:00100000:3.0:1789776548.411029:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+23:9982:x1876716462059776:12345-192.168.202.6@tcp:101:bash.0 Request processed in 8377us (12636us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1789776548.411038:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 88 00000100:00100000:2.0:1789776548.421915:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776548.424385:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462060160 00000100:00100000:3.0:1789776548.424413:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462060160 00000100:00100000:3.0:1789776548.424675:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 89 00000100:00100000:3.0:1789776548.424690:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf29aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+23:9982:x1876716462060160:12345-192.168.202.6@tcp:36:bash.0 00010000:00010000:3.0:1789776548.425079:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef6f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.426482:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef6f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.426528:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef6f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789776548.426670:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1789776548.426730:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e7926a09 reply state 000000005fbefdc3 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef6f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776548.426743:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1789776548.426967:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1789776548.427150:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf29aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+27:9982:x1876716462060160:12345-192.168.202.6@tcp:36:bash.0 Request processed in 2457us (5248us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1789776548.427161:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 89 00000020:00080000:3.0:1789776548.427169:0:5812:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1789776548.431186:0:3259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef6f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.431251:0:3259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef6f5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.431262:0:3259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef6f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.431269:0:3259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86829e0a00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776548.431275:0:3259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef6f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.431284:0:3259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef6f5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.431308:0:3259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c8683789200) 00010000:00010000:3.0:1789776548.431311:0:3259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776548.431326:0:3259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef6f5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.431334:0:3259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef6f5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776548.448404:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776548.448466:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462060288 00000100:00100000:1.0:1789776548.448481:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462060288 00000100:00100000:1.0:1789776548.448566:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 90 00000100:00100000:1.0:1789776548.448581:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+26:9982:x1876716462060288:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:1.0:1789776548.448617:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776548.448646:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef6fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c27fd expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.448731:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef6fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27fd expref: 27 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.448749:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef6fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27fd expref: 27 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.448799:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c8683789200) 00010000:00010000:1.0:1789776548.448803:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789776548.448807:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86bf5cb400, rc 0) 00000100:00100000:1.0:1789776548.448886:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+27:9982:x1876716462060288:12345-192.168.202.6@tcp:101:bash.0 Request processed in 308us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776548.448894:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 90 00000100:00100000:1.0:1789776548.458761:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776548.462024:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462060416 00000100:00100000:0.0:1789776548.462047:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462060416 00000100:00100000:0.0:1789776548.462141:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 33 00000100:00100000:0.0:1789776548.462156:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0795fb8a-e14a-4768-806c-f332ad101de7+6:9982:x1876716462060416:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:0.0:1789776548.462181:0:6662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776548.462212:0:6662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2faab85/0x26940258de8ef703 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2804 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789776548.462267:0:6662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aadd2a3, atime: 0x6aadd2a1, ctime: 0x6aadd2a3, blocks: 0xb 00010000:00010000:0.0:1789776548.462299:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=301s v=(0 0) 00010000:00010000:0.0:1789776548.462305:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789776548.462316:0:6662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2faab85/0x26940258de8ef703 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2804 expref: 7 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.462364:0:6662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d2faab85/0x26940258de8ef703 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2804 expref: 7 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.462382:0:6662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86b9b08800, rc 0) 00000100:00100000:0.0:1789776548.462473:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0795fb8a-e14a-4768-806c-f332ad101de7+7:9982:x1876716462060416:12345-192.168.202.6@tcp:101:bash.0 Request processed in 320us (3729us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776548.462482:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 33 00000100:00100000:3.0:1789776548.473886:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776548.473943:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462060544 00000100:00100000:3.0:1789776548.473956:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462060544 00002000:00010000:3.0:1789776548.474011:0:6665:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1789776548.474017:0:6665:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c86bfeb0380 with x1876716462060544 ext(0->18446744073709551615) 00002000:00010000:3.0:1789776548.474032:0:6665:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c86bfeb0380. 00000100:00100000:3.0:1789776548.474062:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1 00000100:00100000:3.0:1789776548.474071:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bfeb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0795fb8a-e14a-4768-806c-f332ad101de7+7:2357:x1876716462060544:12345-192.168.202.6@tcp:10:bash.0 00002000:00010000:3.0:1789776548.474441:0:6665:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1789776548.474446:0:6665:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1789776547 -> 1789776549 00002000:00010000:3.0:1789776548.474449:0:6665:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1789776545 -> 1789776545 00002000:00010000:3.0:1789776548.474451:0:6665:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789776547 -> 1789776549 00002000:00010000:3.0:1789776548.474454:0:6665:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1789776548.474530:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bfeb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0795fb8a-e14a-4768-806c-f332ad101de7+8:2357:x1876716462060544:12345-192.168.202.6@tcp:10:bash.0 Request processed in 459us (659us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1789776548.474538:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1 00002000:00010000:3.0:1789776548.474542:0:6665:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1789776548.474545:0:6665:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c86bfeb0380 with x1876716462060544 ext(0->18446744073709551615) 00002000:00010000:3.0:1789776548.474549:0:6665:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c86bfeb0380. 00000100:00100000:0.0:1789776548.586686:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776548.586799:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462060672 00000100:00100000:3.0:1789776548.586813:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462060672 00000100:00100000:3.0:1789776548.586904:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 91 00000100:00100000:3.0:1789776548.586939:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8689394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+27:10467:x1876716462060672:12345-192.168.202.6@tcp:34:lfs.0 00010000:00010000:3.0:1789776548.587048:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef70a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.587075:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef70a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.587091:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef70a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.587123:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef711 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.587131:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef711 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.587139:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef711 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.587512:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef718 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.587522:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef718 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.587530:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef718 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789776548.587581:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef718 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.587595:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef70a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.587609:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef70a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.587616:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef70a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.587624:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86829e0a00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776548.587629:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef70a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.587637:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef70a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.587653:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c8682cbe900) 00010000:00010000:3.0:1789776548.587656:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776548.587662:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef70a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.587668:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef70a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.587688:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef711 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.587693:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef711 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.587699:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef711 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.587704:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86829e1200 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776548.587713:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef711 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.587720:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef711 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.587728:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c8682cbec00) 00010000:00010000:3.0:1789776548.587731:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776548.587733:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef711 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.587739:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef711 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.587756:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef718 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.587762:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef718 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.587768:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef718 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.587772:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86829e0400 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776548.587775:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef718 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.587780:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef718 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.587786:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c8683789200) 00010000:00010000:3.0:1789776548.587788:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776548.587798:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef718 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.587804:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef718 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776548.587922:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8689394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+27:10467:x1876716462060672:12345-192.168.202.6@tcp:34:lfs.0 Request processed in 984us (1253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776548.587931:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 91 00000100:00100000:3.0:1789776548.654159:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776548.654364:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776548.654391:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776548.654430:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776548.654468:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462060928 00000100:00100000:3.0:1789776548.654481:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462060928 00000100:00100000:3.0:1789776548.654543:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462061568 00000100:00100000:3.0:1789776548.654546:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462061568 00000100:00100000:3.0:1789776548.654573:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 136 00000100:00100000:3.0:1789776548.654585:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bfeb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+28:2357:x1876716462060928:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1789776548.654842:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bfeb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+28:2357:x1876716462060928:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 257us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776548.654853:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 136 00000100:00100000:3.0:1789776548.654876:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 92 00000100:00100000:3.0:1789776548.654884:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bfeb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+27:10470:x1876716462061568:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1789776548.654899:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776548.654928:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef71f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c280b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.655056:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef726 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.655075:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef726 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.655090:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef726 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.655120:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef72d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.655128:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef72d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.655135:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef72d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.655518:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef734 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.655529:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef734 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.655537:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef734 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776548.655549:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789776548.655699:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef726 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.655708:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef726 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.655724:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef726 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.655731:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86829e1200 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776548.655736:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef726 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.655744:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef726 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776548.656401:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776548.656603:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776548.656645:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462061312 00000100:00100000:1.0:1789776548.656656:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462061312 00000100:00100000:1.0:1789776548.656726:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 137 00000100:00100000:1.0:1789776548.656740:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d27fff26-e747-430b-8151-cc0e7e6df617+5:2356:x1876716462061312:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1789776548.656836:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d27fff26-e747-430b-8151-cc0e7e6df617+5:2356:x1876716462061312:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 99us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776548.656845:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 137 00000100:00080000:1.0:1789776548.656873:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789776548.657380:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462061184 00000100:00100000:2.0:1789776548.657387:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462061184 00000100:00100000:2.0:1789776548.657448:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462061056 00000100:00100000:2.0:1789776548.657452:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462061056 00000100:00100000:2.0:1789776548.657479:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 74 00000100:00100000:2.0:1789776548.657487:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bfeb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0795fb8a-e14a-4768-806c-f332ad101de7+5:2357:x1876716462061184:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1789776548.657536:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bfeb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0795fb8a-e14a-4768-806c-f332ad101de7+5:2357:x1876716462061184:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 49us (3143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776548.657543:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 74 00000100:00100000:2.0:1789776548.657558:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 75 00000100:00100000:2.0:1789776548.657564:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba7d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0795fb8a-e14a-4768-806c-f332ad101de7+8:2356:x1876716462061056:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1789776548.657591:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba7d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0795fb8a-e14a-4768-806c-f332ad101de7+8:2356:x1876716462061056:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 27us (1196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776548.657597:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 75 00000100:00080000:1.0:1789776548.658512:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789776548.659448:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c8682cbe900) 00010000:00010000:3.0:1789776548.659460:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776548.659472:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef726 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.659486:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8ef726 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.659515:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef72d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.659522:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef72d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.659529:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef72d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.659535:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86829e0a00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776548.659539:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef72d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.659576:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef72d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.659587:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c8682cbec00) 00010000:00010000:3.0:1789776548.659589:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776548.659593:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef72d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.659599:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8ef72d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.661108:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8ef71f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c280b expref: 30 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.661139:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef734 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c280b expref: 29 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.661149:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c8683789200) 00010000:00010000:3.0:1789776548.661152:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789776548.661156:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86829e0e00, rc 0) 00000100:00100000:3.0:1789776548.661290:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bfeb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+29:10470:x1876716462061568:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 6403us (6855us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1789776548.661302:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 92 00000100:00100000:0.0:1789776548.664880:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462060800 00000100:00100000:0.0:1789776548.664904:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462060800 00000100:00100000:0.0:1789776548.665078:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 285 00000100:00100000:0.0:1789776548.665091:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa597050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:2356:x1876716462060800:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1789776548.665273:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa597050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:2356:x1876716462060800:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 185us (11131us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776548.665283:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 285 00000100:00100000:3.0:1789776548.672290:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776548.672394:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462061696 00000100:00100000:1.0:1789776548.672409:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462061696 00000100:00100000:1.0:1789776548.672486:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 93 00000100:00100000:1.0:1789776548.672499:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bfeb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+29:10470:x1876716462061696:12345-192.168.202.6@tcp:54:lfs.0 00010000:00010000:1.0:1789776548.672598:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8ef742 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.672938:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8ef6e7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27f6 expref: 29 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.672970:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8ef742 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.673022:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8ef6e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27f6 expref: 29 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.673040:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8ef6e7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27f6 expref: 29 pid: 5811 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776548.673058:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7bd880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1876716471518720:192.168.202.6@tcp:104: 00000100:00100000:1.0:1789776548.673206:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bc8f6840 going to sleep for 11 seconds 00000100:00100000:1.0:1789776548.676991:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7bd880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1876716471518720:192.168.202.6@tcp:104: 00010000:00010000:1.0:1789776548.677037:0:5813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8ef742 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776548.677113:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776548.677211:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462061952 00000100:00100000:3.0:1789776548.677244:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462061952 00000100:00100000:3.0:1789776548.677320:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 22 00000100:00100000:3.0:1789776548.677331:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf298700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+30:5596:x1876716462061952:12345-192.168.202.6@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789776548.679662:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf298700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+31:5596:x1876716462061952:12345-192.168.202.6@tcp:35:ldlm_bl.0 Request processed in 2316us (2544us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1789776548.681604:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 22 00000100:00100000:3.0:1789776548.689348:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776548.690372:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462062080 00000100:00100000:0.0:1789776548.690393:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462062080 00010000:00010000:0.0:1789776548.690456:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8ef6e7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27f6 expref: 31 pid: 5811 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776548.690517:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 48 00000100:00100000:0.0:1789776548.690531:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bfeb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0795fb8a-e14a-4768-806c-f332ad101de7+31:2356:x1876716462062080:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789776548.690552:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776548.690561:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8ef6e7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27f6 expref: 31 pid: 5811 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.690598:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8ef6e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27f6 expref: 31 pid: 5811 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.690644:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8ef6e7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27f6 expref: 31 pid: 5811 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.690669:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c8683789200) 00010000:00010000:0.0:1789776548.690915:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8ef742 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.690930:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8ef742 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.690940:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8ef742 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.690989:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789776548.691148:0:5813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8ef742 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.691158:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8ef742 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.691200:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8ef742 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.691208:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8ef742 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.691256:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8ef742 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.691276:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5cb200 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776548.691282:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8ef742 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.691289:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8ef742 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.691300:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c8683789200) 00010000:00010000:1.0:1789776548.691303:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789776548.691307:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8ef742 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776548.691313:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8ef742 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776548.698083:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bfeb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0795fb8a-e14a-4768-806c-f332ad101de7+30:2356:x1876716462062080:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 7529us (8726us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776548.698118:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 48 00000100:00100000:1.0:1789776548.698764:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bfeb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+29:10470:x1876716462061696:12345-192.168.202.6@tcp:54:lfs.0 Request processed in 26253us (26476us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776548.698779:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 93 00000100:00100000:1.0:1789776548.706699:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776548.707009:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462062336 00000100:00100000:0.0:1789776548.707024:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462062336 00000100:00100000:0.0:1789776548.707094:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 23 00000100:00100000:0.0:1789776548.707116:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+29:10470:x1876716462062336:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:0.0:1789776548.707489:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+30:10470:x1876716462062336:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 384us (812us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1789776548.707498:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 23 00010000:00010000:1.0:1789776548.756462:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776548.835338:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776548.835502:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462062592 00000100:00100000:0.0:1789776548.835516:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462062592 00000100:00100000:0.0:1789776548.835598:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 94 00000100:00100000:0.0:1789776548.835612:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+30:10482:x1876716462062592:12345-192.168.202.6@tcp:101:cat.0 00010000:00010000:0.0:1789776548.835659:0:8177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776548.835698:0:8177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09800/0x26940258de8ef749 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2812 expref: -99 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.835802:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08000/0x26940258de8ef750 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.835820:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08000/0x26940258de8ef750 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.835834:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08000/0x26940258de8ef750 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.835853:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09200/0x26940258de8ef757 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.835861:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09200/0x26940258de8ef757 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.835868:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09200/0x26940258de8ef757 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.836274:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09400/0x26940258de8ef75e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.836285:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09400/0x26940258de8ef75e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.836306:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09400/0x26940258de8ef75e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776548.836318:0:8177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:0.0:1789776548.836445:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08000/0x26940258de8ef750 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.836454:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08000/0x26940258de8ef750 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.836462:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08000/0x26940258de8ef750 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.836469:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b08000 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776548.836475:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08000/0x26940258de8ef750 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.836483:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08000/0x26940258de8ef750 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.836498:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c8682cbe900) 00010000:00010000:0.0:1789776548.836502:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776548.836507:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08000/0x26940258de8ef750 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.836514:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08000/0x26940258de8ef750 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.836529:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09200/0x26940258de8ef757 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.836534:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09200/0x26940258de8ef757 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.836547:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09200/0x26940258de8ef757 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.836553:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b09200 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776548.836555:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09200/0x26940258de8ef757 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.836561:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09200/0x26940258de8ef757 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.836569:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c86a08dfd00) 00010000:00010000:0.0:1789776548.836571:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776548.836574:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09200/0x26940258de8ef757 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.836579:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09200/0x26940258de8ef757 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.836635:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09800/0x26940258de8ef749 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2812 expref: 33 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.836650:0:8177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09400/0x26940258de8ef75e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2812 expref: 32 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.836657:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c8683789200) 00010000:00010000:0.0:1789776548.836659:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789776548.836662:0:8177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86b9b09400, rc 0) 00000100:00100000:0.0:1789776548.836921:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+32:10482:x1876716462062592:12345-192.168.202.6@tcp:101:cat.0 Request processed in 1312us (1597us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1789776548.836941:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 94 00000100:00100000:3.0:1789776548.843607:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776548.843691:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462062848 00000100:00100000:1.0:1789776548.843706:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462062848 00000100:00100000:1.0:1789776548.843785:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 24 00000100:00100000:1.0:1789776548.843799:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bfeb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+32:10482:x1876716462062848:12345-192.168.202.6@tcp:35:cat.0 00000100:00100000:1.0:1789776548.844181:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bfeb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+33:10482:x1876716462062848:12345-192.168.202.6@tcp:35:cat.0 Request processed in 382us (587us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1789776548.844190:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 24 00000100:00100000:1.0:1789776548.872500:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776548.872639:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462063104 00000100:00100000:3.0:1789776548.872654:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462063104 00000100:00100000:3.0:1789776548.872746:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 95 00000100:00100000:3.0:1789776548.872760:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+33:10483:x1876716462063104:12345-192.168.202.6@tcp:36:rm.0 00010000:00010000:3.0:1789776548.872862:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789776548.872909:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09400/0x26940258de8ef75e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2812 expref: 33 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.872941:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8ef734 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c280b expref: 32 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.872961:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef6fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27fd expref: 31 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.872973:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c8683789200) 00010000:00010000:3.0:1789776548.872996:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789776548.873031:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8ef76c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.873050:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8ef76c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.873063:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8ef76c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.873091:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8ef773 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.873109:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8ef773 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.873117:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8ef773 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.873546:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8ef77a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.873556:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8ef77a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.873563:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8ef77a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789776548.874358:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1789776548.874375:0:5812:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 301654157882ns, next at 302654152706ns, rc = 0 00010000:00010000:3.0:1789776548.874453:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8ef781 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.874466:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8ef781 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.874475:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8ef781 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.874483:0:5812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8ef781 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.874501:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8ef781 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.874507:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8ef781 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.874528:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789776548.874557:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8ef77a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.874563:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8ef77a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.874570:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8ef77a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.874575:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681678800 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776548.874581:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8ef77a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.874589:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8ef77a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.874602:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c8682cbee00) 00010000:00010000:3.0:1789776548.874606:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789776548.874611:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8ef77a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.874617:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8ef77a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.874640:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8ef76c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.874652:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8ef76c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.874658:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8ef76c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.874663:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681678a00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776548.874667:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8ef76c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.874673:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8ef76c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.874681:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c8682cbe900) 00010000:00010000:3.0:1789776548.874684:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776548.874687:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8ef76c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.874693:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8ef76c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789776548.874705:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004bbf621e reply state 00000000d1b5174d transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8ef773 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776548.874715:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789776548.874836:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+32:10483:x1876716462063104:12345-192.168.202.6@tcp:36:rm.0 Request processed in 2073us (2346us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1789776548.874847:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 95 00010000:00010000:0.0:1789776548.875297:0:8419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789776548.875306:0:8419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8ef781 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.875313:0:8419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681679000 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:0.0:1789776548.875318:0:8419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8ef781 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.875324:0:8419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8ef781 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.875336:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c8682cbee00) 00010000:00010000:0.0:1789776548.875338:0:8419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789776548.875341:0:8419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8ef781 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.875346:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8ef781 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.875364:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776548.875366:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776548.875367:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776548.887210:0:3260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8ef773 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776548.887262:0:3260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8ef773 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776548.887271:0:3260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8ef773 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776548.887312:0:3260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681678000 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776548.887319:0:3260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8ef773 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776548.887329:0:3260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8ef773 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776548.887355:0:3260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c8682cbec00) 00010000:00010000:2.0:1789776548.887359:0:3260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776548.887366:0:3260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8ef773 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776548.887373:0:3260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8ef773 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776548.928369:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776548.930434:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462063360 00000100:00100000:3.0:1789776548.930456:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462063360 00000100:00100000:3.0:1789776548.930561:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 96 00000100:00100000:3.0:1789776548.930572:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+31:10489:x1876716462063360:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:3.0:1789776548.930606:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776548.930646:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8ef788 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2819 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.930822:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8ef78f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.930840:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8ef78f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.930854:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8ef78f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.930869:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8ef796 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.930877:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8ef796 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.930883:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8ef796 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789776548.931975:0:5811:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1789776548.932341:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8ef79d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.932357:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8ef79d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.932370:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8ef79d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.932419:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8ef78f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.932427:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8ef78f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.932435:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8ef78f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.932441:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681678a00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776548.932446:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8ef78f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.932454:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8ef78f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.932466:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c8682cbe900) 00010000:00010000:3.0:1789776548.932469:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776548.932475:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8ef78f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.932482:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8ef78f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789776548.932499:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000037575d98 reply state 00000000b0a1df5e transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8ef796 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776548.932508:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789776548.932543:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8ef788 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2819 expref: 34 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.932573:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8ef79d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2819 expref: 33 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776548.932581:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c8682cbec00) 00010000:00010000:3.0:1789776548.932584:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789776548.932586:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8681679c00, rc 0) 00000100:00100000:3.0:1789776548.932942:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+34:10489:x1876716462063360:12345-192.168.202.6@tcp:101:bash.0 Request processed in 2368us (4587us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1789776548.932952:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 96 00000100:00100000:3.0:1789776548.940577:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00010000:0.0:1789776548.941353:0:3259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8ef796 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.941371:0:3259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8ef796 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.941380:0:3259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8ef796 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.941410:0:3259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681678800 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776548.941416:0:3259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8ef796 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.941425:0:3259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8ef796 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.941446:0:3259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c8682cbe000) 00010000:00010000:0.0:1789776548.941449:0:3259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776548.941454:0:3259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8ef796 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.941460:0:3259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8ef796 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776548.941599:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462063488 00000100:00100000:2.0:1789776548.941614:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462063488 00000100:00100000:2.0:1789776548.941819:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 34 00000100:00100000:2.0:1789776548.941833:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bfeb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0795fb8a-e14a-4768-806c-f332ad101de7+5:2356:x1876716462063488:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:2.0:1789776548.941859:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776548.941887:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004210e610/0x26940258de8ef7ab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2820 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789776548.941922:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789776548.941947:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=301s v=(0 0) 00010000:00010000:2.0:1789776548.941952:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776548.941963:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004210e610/0x26940258de8ef7ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2820 expref: 6 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776548.941997:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004210e610/0x26940258de8ef7ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2820 expref: 6 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776548.942011:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8686775000, rc 0) 00000100:00100000:2.0:1789776548.942111:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bfeb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0795fb8a-e14a-4768-806c-f332ad101de7+6:2356:x1876716462063488:12345-192.168.202.6@tcp:101:bash.0 Request processed in 272us (1540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776548.942119:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 34 00000100:00100000:0.0:1789776548.949628:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776548.949879:0:8384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462063616 00000100:00100000:2.0:1789776548.949894:0:8384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462063616 00000100:00100000:2.0:1789776548.949984:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 35 00000100:00100000:2.0:1789776548.949998:0:8384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8689394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0795fb8a-e14a-4768-806c-f332ad101de7+6:10489:x1876716462063616:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:2.0:1789776548.950025:0:8384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776548.950052:0:8384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000403f2cc9/0x26940258de8ef7b2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2827 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776548.950109:0:8384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004210e610/0x26940258de8ef7ab lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2820 expref: 7 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776548.950122:0:8384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776548.950127:0:8384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776548.950134:0:8384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000403f2cc9/0x26940258de8ef7b2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2827 expref: 7 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776548.950192:0:8384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004210e610/0x26940258de8ef7ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2820 expref: 7 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776548.950292:0:8384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004210e610/0x26940258de8ef7ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2820 expref: 7 pid: 6659 timeout: 401 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776548.950310:0:8384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8384:1876716471518848:192.168.202.6@tcp:104: 00000100:00100000:2.0:1789776548.950523:0:8384:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86878f0180 going to sleep for 11 seconds 00000100:00100000:3.0:1789776548.956158:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776548.956646:0:11142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462063744 00000100:00100000:0.0:1789776548.956661:0:11142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462063744 00010000:00010000:0.0:1789776548.956729:0:11142:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004210e610/0x26940258de8ef7ab lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2820 expref: 8 pid: 6659 timeout: 401 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776548.956793:0:11142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 49 00000100:00100000:0.0:1789776548.956805:0:11142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c869880f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0795fb8a-e14a-4768-806c-f332ad101de7+8:2356:x1876716462063744:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789776548.956825:0:11142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776548.956856:0:11142:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004210e610/0x26940258de8ef7ab lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2820 expref: 8 pid: 6659 timeout: 401 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.956876:0:11142:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004210e610/0x26940258de8ef7ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2820 expref: 8 pid: 6659 timeout: 401 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.956935:0:11142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789776548.956941:0:11142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789776548.956952:0:11142:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000403f2cc9/0x26940258de8ef7b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2827 expref: 8 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.956964:0:11142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000403f2cc9/0x26940258de8ef7b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2827 expref: 8 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776548.957014:0:11142:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000403f2cc9/0x26940258de8ef7b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2827 expref: 8 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776548.957031:0:11142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c8689397b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11142:1876716471518976:192.168.202.6@tcp:105: 00000100:00100000:0.0:1789776548.957151:0:11142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86903e6e40 going to sleep for 11 seconds 00010000:00010000:2.0:1789776548.960037:0:8384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004210e610/0x26940258de8ef7ab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2820 expref: 8 pid: 6659 timeout: 401 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776548.960072:0:8384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8384:1876716471518848:192.168.202.6@tcp:104: 00010000:00010000:2.0:1789776548.960125:0:8384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000403f2cc9/0x26940258de8ef7b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2827 expref: 7 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776548.960143:0:8384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8686775400, rc 0) 00000100:00100000:2.0:1789776548.960327:0:8384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8689394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0795fb8a-e14a-4768-806c-f332ad101de7+7:10489:x1876716462063616:12345-192.168.202.6@tcp:101:bash.0 Request processed in 10331us (10723us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776548.960336:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 35 00000100:00100000:0.0:1789776548.970359:0:11142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c8689397b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11142:1876716471518976:192.168.202.6@tcp:105: 00010000:00010000:0.0:1789776548.970403:0:11142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776548.970493:0:11142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c869880f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0795fb8a-e14a-4768-806c-f332ad101de7+6:2356:x1876716462063744:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 13688us (14353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776548.970508:0:11142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 49 00000100:00100000:0.0:1789776548.983299:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776548.983431:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462064000 00000100:00100000:1.0:1789776548.983445:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462064000 00000100:00100000:1.0:1789776548.983527:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 25 00000100:00100000:1.0:1789776548.983539:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8689397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+33:10489:x1876716462064000:12345-192.168.202.6@tcp:35:bash.0 00000100:00100000:1.0:1789776548.984058:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8689397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+34:10489:x1876716462064000:12345-192.168.202.6@tcp:35:bash.0 Request processed in 518us (842us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1789776548.984066:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 25 00000100:00100000:3.0:1789776549.151626:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776549.160062:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462064128 00000100:00100000:1.0:1789776549.160088:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462064128 00000100:00080000:2.0:1789776549.160383:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789776549.160608:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 97 00000100:00100000:3.0:1789776549.160626:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bfeb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+34:10505:x1876716462064128:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1789776549.160662:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776549.160703:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8ef7b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c282e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776549.160813:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8ef7c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776549.160833:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8ef7c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776549.160849:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8ef7c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776549.160925:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1789776549.160930:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789776549.160956:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8ef7c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776549.160992:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8ef7b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c282e expref: 36 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776549.161026:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8ef7c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c282e expref: 35 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776549.161037:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c8682cbe900) 00010000:00010000:3.0:1789776549.161041:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789776549.161047:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8681679400, rc 0) 00000100:00100000:3.0:1789776549.163973:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bfeb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+35:10505:x1876716462064128:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 3334us (12345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776549.163990:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 97 00000100:00100000:3.0:1789776549.175552:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776549.176081:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462064384 00000100:00100000:0.0:1789776549.176106:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462064384 00000100:00100000:0.0:1789776549.176196:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 98 00000100:00100000:0.0:1789776549.176209:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bfeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+35:10505:x1876716462064384:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1789776549.176295:0:8177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776549.176344:0:8177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef7c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2835 expref: -99 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.176486:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09600/0x26940258de8ef7ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.176506:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09600/0x26940258de8ef7ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.176521:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09600/0x26940258de8ef7ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776549.176536:0:8177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789776549.177038:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef7c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2835 expref: 38 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.177063:0:8177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09600/0x26940258de8ef7ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2835 expref: 37 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.177073:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c8682cbec00) 00010000:00010000:0.0:1789776549.177075:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789776549.177080:0:8177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86b9b09600, rc 0) 00000100:00100000:0.0:1789776549.177391:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bfeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+37:10505:x1876716462064384:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 1182us (1853us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1789776549.177401:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 98 00000100:00100000:1.0:1789776549.188650:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776549.188713:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776549.188877:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462064768 00000100:00100000:2.0:1789776549.188893:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462064768 00000100:00100000:2.0:1789776549.188983:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 6 00000100:00100000:2.0:1789776549.188996:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0795fb8a-e14a-4768-806c-f332ad101de7+37:2354:x1876716462064768:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789776549.189019:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776549.189055:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09600/0x26940258de8ef7ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2835 expref: 37 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776549.189109:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c8682cbec00) 00010000:00010000:2.0:1789776549.189116:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776549.189211:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0795fb8a-e14a-4768-806c-f332ad101de7+36:2354:x1876716462064768:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 216us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776549.189254:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 6 00000100:00100000:3.0:1789776549.190019:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462064640 00000100:00100000:3.0:1789776549.190028:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462064640 00000100:00100000:3.0:1789776549.190081:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 99 00000100:00100000:3.0:1789776549.190090:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+36:10505:x1876716462064640:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1789776549.190132:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776549.190155:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8ef7dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c283c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776549.190473:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8ef7e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776549.190572:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8ef7e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776549.190585:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8ef7e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776549.190603:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789776549.190939:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8ef7dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c283c expref: 39 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776549.203877:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8ef7e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c283c expref: 38 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776549.203892:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c8682cbec00) 00010000:00010000:3.0:1789776549.203895:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789776549.203900:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8681679200, rc 0) 00000100:00100000:2.0:1789776549.204093:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+38:10505:x1876716462064640:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 14000us (15455us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1789776549.204114:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 99 00000100:00100000:3.0:1789776549.214777:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776549.214865:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462064896 00000100:00100000:2.0:1789776549.214880:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462064896 00000100:00100000:2.0:1789776549.214975:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 36 00000100:00100000:2.0:1789776549.214990:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bfeb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0795fb8a-e14a-4768-806c-f332ad101de7+6:2357:x1876716462064896:12345-192.168.202.6@tcp:1:lfs.0 00010000:00010000:2.0:1789776549.215067:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b2c16c5/0x26940258de8ef7f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776549.215104:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000403f2cc9/0x26940258de8ef7b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2827 expref: 6 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776549.215116:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776549.215122:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789776549.215128:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b2c16c5/0x26940258de8ef7f1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776549.215175:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000403f2cc9/0x26940258de8ef7b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2827 expref: 6 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776549.215276:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000403f2cc9/0x26940258de8ef7b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2827 expref: 6 pid: 8384 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776549.215296:0:6659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6659:1876716471519104:192.168.202.6@tcp:104: 00000100:00100000:2.0:1789776549.215421:0:6659:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86878f0180 going to sleep for 11 seconds 00000100:00100000:2.0:1789776549.221302:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776549.221497:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462065024 00000100:00100000:1.0:1789776549.221512:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462065024 00002000:00100000:1.0:1789776549.221590:0:6667:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9c86bf7aad80 x1876716462065024/t0(0) o4->0795fb8a-e14a-4768-806c-f332ad101de7@192.168.202.6@tcp:740/0 lens 504/0 e 0 to 0 dl 1789776560 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789776549.221606:0:6667:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c86bf7aad80 with x1876716462065024 ext(0->8) 00010000:00010000:1.0:1789776549.221629:0:6667:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000403f2cc9/0x26940258de8ef7b2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2827 expref: 7 pid: 8384 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.221652:0:6667:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000403f2cc9/0x26940258de8ef7b2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2827 expref: 7 pid: 8384 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789776549.221664:0:6667:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9c86bf7aad80 00000100:00100000:1.0:1789776549.221716:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1 00000100:00100000:1.0:1789776549.221729:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0795fb8a-e14a-4768-806c-f332ad101de7+7:2356:x1876716462065024:12345-192.168.202.6@tcp:4:lfs.0 00000100:00100000:1.0:1789776549.222569:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0795fb8a-e14a-4768-806c-f332ad101de7+9:2356:x1876716462065024:12345-192.168.202.6@tcp:4:lfs.0 Request processed in 837us (1278us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789776549.222590:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1 00002000:00100000:1.0:1789776549.222601:0:6667:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9c86bf7aad80 x1876716462065024/t4294967302(0) o4->0795fb8a-e14a-4768-806c-f332ad101de7@192.168.202.6@tcp:740/0 lens 504/448 e 0 to 0 dl 1789776560 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789776549.222610:0:6667:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c86bf7aad80 with x1876716462065024 ext(0->8) 00010000:00010000:1.0:1789776549.222618:0:6667:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000403f2cc9/0x26940258de8ef7b2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2827 expref: 9 pid: 8384 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.222635:0:6667:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000403f2cc9/0x26940258de8ef7b2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2827 expref: 9 pid: 8384 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789776549.222644:0:6667:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9c86bf7aad80 00000100:00100000:3.0:1789776549.223137:0:6659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6659:1876716471519104:192.168.202.6@tcp:104: 00010000:00010000:3.0:1789776549.223168:0:6659:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002b2c16c5/0x26940258de8ef7f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776549.229161:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776549.233692:0:11144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462065152 00000100:00100000:1.0:1789776549.233715:0:11144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462065152 00010000:00010000:1.0:1789776549.233785:0:11144:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000403f2cc9/0x26940258de8ef7b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2827 expref: 9 pid: 8384 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776549.233845:0:11144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 50 00000100:00100000:1.0:1789776549.233858:0:11144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bfeb1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0795fb8a-e14a-4768-806c-f332ad101de7+9:2354:x1876716462065152:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776549.233878:0:11144:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789776549.233904:0:11144:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789776549.233907:0:11144:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789776549 00002000:00010000:1.0:1789776549.233910:0:11144:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789776549 00002000:00010000:1.0:1789776549.233912:0:11144:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789776549 00010000:00010000:1.0:1789776549.233919:0:11144:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000403f2cc9/0x26940258de8ef7b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2827 expref: 9 pid: 8384 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.233962:0:11144:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000403f2cc9/0x26940258de8ef7b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2827 expref: 9 pid: 8384 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.233998:0:11144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000403f2cc9/0x26940258de8ef7b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2827 expref: 9 pid: 8384 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.234021:0:11144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=1s v=(1 0) 00010000:00010000:1.0:1789776549.234026:0:11144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789776549.234034:0:11144:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002b2c16c5/0x26940258de8ef7f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.234046:0:11144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b2c16c5/0x26940258de8ef7f1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.234091:0:11144:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789776549.234192:0:6659:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002b2c16c5/0x26940258de8ef7f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776549.234202:0:11144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bfeb1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0795fb8a-e14a-4768-806c-f332ad101de7+8:2354:x1876716462065152:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 344us (5055us total) trans 0 rc 0/0 00010000:00010000:3.0:1789776549.234212:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b2c16c5/0x26940258de8ef7f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776549.234258:0:11144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 50 00010000:00010000:3.0:1789776549.234309:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b2c16c5/0x26940258de8ef7f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776549.234319:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b2c16c5/0x26940258de8ef7f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776549.234328:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b2c16c5/0x26940258de8ef7f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776549.234336:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8686775e00 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:3.0:1789776549.234342:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b2c16c5/0x26940258de8ef7f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776549.234353:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b2c16c5/0x26940258de8ef7f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776549.234367:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b2c16c5/0x26940258de8ef7f1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776549.234376:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b2c16c5/0x26940258de8ef7f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776549.234435:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bfeb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0795fb8a-e14a-4768-806c-f332ad101de7+7:2357:x1876716462064896:12345-192.168.202.6@tcp:1:lfs.0 Request processed in 19449us (19675us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776549.234444:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 36 00000100:00100000:3.0:1789776549.241375:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776549.241480:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462065408 00000100:00100000:1.0:1789776549.241495:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462065408 00000100:00100000:1.0:1789776549.241577:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 26 00000100:00100000:1.0:1789776549.241590:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a0685050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+38:10505:x1876716462065408:12345-192.168.202.6@tcp:35:lfs.0 00000004:00010000:1.0:1789776549.241712:0:5814:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8ef7e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c283c expref: 38 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789776549.242087:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1789776549.242151:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1789776549.242604:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1789776549.242672:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef7f8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.242692:0:5814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8ef79d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2819 expref: 42 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.242703:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef7f8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.242747:0:5814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8ef79d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2819 expref: 42 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.242766:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8ef79d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2819 expref: 42 pid: 5811 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776549.242782:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7bd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5814:1876716471519232:192.168.202.6@tcp:104: 00000100:00100000:1.0:1789776549.242894:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bc8f6840 going to sleep for 11 seconds 00000100:00100000:1.0:1789776549.245714:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7bd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5814:1876716471519232:192.168.202.6@tcp:104: 00010000:00010000:1.0:1789776549.245764:0:5814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef7f8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776549.250578:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776549.250693:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462065536 00000100:00100000:1.0:1789776549.250708:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462065536 00010000:00010000:1.0:1789776549.250768:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8ef79d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2819 expref: 43 pid: 5811 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776549.250851:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 51 00000100:00100000:1.0:1789776549.250863:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bfeb3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0795fb8a-e14a-4768-806c-f332ad101de7+43:2356:x1876716462065536:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776549.250885:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776549.250893:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8ef79d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2819 expref: 43 pid: 5811 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.250909:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8ef79d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2819 expref: 43 pid: 5811 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.250942:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8ef79d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2819 expref: 43 pid: 5811 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.250968:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c8682cbec00) 00010000:00010000:1.0:1789776549.250975:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef7f8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.250987:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef7f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.250995:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef7f8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.251045:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776549.251131:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bfeb3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0795fb8a-e14a-4768-806c-f332ad101de7+42:2356:x1876716462065536:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 270us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776549.251139:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 51 00010000:00010000:0.0:1789776549.251520:0:5814:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef7f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.251531:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef7f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789776549.251713:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1789776549.251980:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1789776549.252588:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c8689394700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5814:1876716471519360:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789776549.252664:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776549.255389:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86903e6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789776549.256988:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471519360 00000100:00100000:2.0:1789776549.257007:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471519360 00000100:00100000:2.0:1789776549.257258:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789776549.257273:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8689396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5814:x1876716471519360:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789776549.257431:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8689396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5814:x1876716471519360:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 162us (4767us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776549.257439:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789776549.259676:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c8689394700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5814:1876716471519360:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:1.0:1789776549.260875:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1789776549.263237:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1789776549.263518:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7abb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5814:1876716471519488:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789776549.263577:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776549.263616:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86878f03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776549.263679:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471519488 00000100:00100000:1.0:1789776549.263696:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471519488 00000100:00100000:1.0:1789776549.263845:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789776549.263858:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9deea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5814:x1876716471519488:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789776549.264184:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9deea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5814:x1876716471519488:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 328us (603us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789776549.264193:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789776549.266080:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7abb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5814:1876716471519488:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789776549.266192:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:2.0:1789776549.266272:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef7f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776549.266283:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef7f8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776549.266290:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef7f8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776549.266310:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5cbc00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776549.266315:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef7f8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776549.266458:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef7f8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776549.266477:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c8682cbec00) 00010000:00010000:2.0:1789776549.266480:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789776549.266486:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef7f8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776549.266493:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef7f8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789776549.266709:0:5814:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789776549.266963:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1789776549.266973:0:5814:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 302046755892ns, next at 303046754197ns, rc = 0 00000001:00080000:2.0:1789776549.266980:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1789776549.267010:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c8682cbec00) 00010000:00010000:2.0:1789776549.267012:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789776549.267019:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8ef7e3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c283c expref: 46 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776549.268406:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a0685050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+45:10505:x1876716462065408:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 26812us (27039us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1789776549.268422:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 26 00000020:00080000:2.0:1789776549.268432:0:5814:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789776549.271460:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776549.271558:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462065664 00000100:00100000:0.0:1789776549.271574:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462065664 00000100:00100000:1.0:1789776549.272492:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 100 00000100:00100000:1.0:1789776549.272521:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bfeb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+45:10505:x1876716462065664:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1789776549.272558:0:8177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776549.272590:0:8177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef7ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2843 expref: -99 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.272674:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef7ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2843 expref: 46 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.272693:0:8177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef7ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2843 expref: 46 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.272715:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c8683789400) 00010000:00010000:1.0:1789776549.272718:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789776549.272722:0:8177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86bf5cb600, rc 0) 00000100:00100000:1.0:1789776549.272831:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bfeb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+46:10505:x1876716462065664:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 324us (1388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776549.276042:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 100 00000100:00100000:3.0:1789776549.280593:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776549.280830:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462065920 00000100:00100000:2.0:1789776549.280843:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462065920 00000100:00100000:2.0:1789776549.280925:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 27 00000100:00100000:2.0:1789776549.280936:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bfeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+46:10505:x1876716462065920:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:2.0:1789776549.281610:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bfeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+47:10505:x1876716462065920:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 673us (1029us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1789776549.281618:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 27 00000100:00100000:2.0:1789776549.380363:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776549.380474:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462066048 00000100:00100000:0.0:1789776549.380487:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462066048 00000100:00100000:0.0:1789776549.380558:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 101 00000100:00100000:0.0:1789776549.380570:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9deca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+47:10515:x1876716462066048:12345-192.168.202.6@tcp:34:lfs.0 00010000:00010000:0.0:1789776549.380670:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef806 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.380692:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef806 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.380706:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef806 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.380724:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef80d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.380731:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef80d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.380739:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef80d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.380885:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09e00/0x26940258de8ef814 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.380895:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09e00/0x26940258de8ef814 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.380902:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09e00/0x26940258de8ef814 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789776549.380953:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09e00/0x26940258de8ef814 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.380967:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef806 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.380974:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef806 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.380982:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef806 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.380989:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b08400 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776549.380994:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef806 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.381002:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef806 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.381015:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c8682cbe900) 00010000:00010000:0.0:1789776549.381018:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776549.381022:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef806 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.381038:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef806 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.381054:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef80d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.381060:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef80d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.381066:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef80d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.381071:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b09000 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776549.381074:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef80d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.381080:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef80d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.381088:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c86a08dfd00) 00010000:00010000:0.0:1789776549.381090:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776549.381093:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef80d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.381110:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef80d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.381126:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09e00/0x26940258de8ef814 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.381132:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09e00/0x26940258de8ef814 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.381144:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09e00/0x26940258de8ef814 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.381149:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b09e00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776549.381152:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09e00/0x26940258de8ef814 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.381158:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09e00/0x26940258de8ef814 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.381166:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c8683789400) 00010000:00010000:0.0:1789776549.381169:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776549.381172:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09e00/0x26940258de8ef814 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.381178:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09e00/0x26940258de8ef814 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776549.385898:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9deca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+47:10515:x1876716462066048:12345-192.168.202.6@tcp:34:lfs.0 Request processed in 5312us (5535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776549.385948:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 101 00000100:00100000:3.0:1789776549.419974:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776549.420413:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462066304 00000100:00100000:0.0:1789776549.420429:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462066304 00000100:00100000:0.0:1789776549.420543:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 102 00000100:00100000:0.0:1789776549.420554:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bfeb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+47:10518:x1876716462066304:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1789776549.420582:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776549.420611:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09e00/0x26940258de8ef81b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c284a expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.420715:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef822 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.420735:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef822 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.420778:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef822 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.420805:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef829 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.420813:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef829 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.420820:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef829 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.420987:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef830 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.420997:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef830 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.421005:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef830 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776549.421017:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789776549.421166:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef822 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.421175:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef822 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.421183:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef822 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.421189:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b09000 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776549.421202:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef822 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.421211:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef822 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.421257:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c8682cbe900) 00010000:00010000:0.0:1789776549.421260:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776549.421265:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef822 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.421272:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef822 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.421287:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef829 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.421294:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef829 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.421300:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef829 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.421304:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b08400 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776549.421306:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef829 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.421312:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef829 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.421319:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c86a08dfd00) 00010000:00010000:0.0:1789776549.421321:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776549.421330:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef829 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.421337:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef829 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.421388:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09e00/0x26940258de8ef81b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c284a expref: 50 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.421402:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef830 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c284a expref: 49 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.421409:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c8683789400) 00010000:00010000:0.0:1789776549.421412:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789776549.421415:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86b9b08e00, rc 0) 00000100:00100000:0.0:1789776549.421509:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bfeb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+49:10518:x1876716462066304:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 956us (1552us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1789776549.421519:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 102 00000100:00100000:3.0:1789776549.424256:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776549.424888:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462066432 00000100:00100000:1.0:1789776549.424902:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462066432 00000100:00100000:1.0:1789776549.424983:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 103 00000100:00100000:1.0:1789776549.424996:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bfeb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+49:10518:x1876716462066432:12345-192.168.202.6@tcp:54:lfs.0 00010000:00010000:1.0:1789776549.425115:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef83e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.425141:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef83e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.425154:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef83e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.425189:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef83e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.425198:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef83e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.425205:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef83e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.425212:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5ca400 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776549.425241:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef83e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.425250:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef83e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.425264:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c8683789400) 00010000:00010000:1.0:1789776549.425287:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789776549.425294:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef83e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.425301:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef83e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776549.425390:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bfeb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+49:10518:x1876716462066432:12345-192.168.202.6@tcp:54:lfs.0 Request processed in 396us (1191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776549.425399:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 103 00000100:00100000:2.0:1789776549.428375:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776549.428699:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462066688 00000100:00100000:1.0:1789776549.428713:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462066688 00000100:00100000:1.0:1789776549.428864:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 28 00000100:00100000:1.0:1789776549.428876:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+49:10518:x1876716462066688:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:1.0:1789776549.429193:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+50:10518:x1876716462066688:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 318us (830us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1789776549.429202:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 28 00000100:00100000:3.0:1789776549.488154:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776549.488294:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462066944 00000100:00100000:1.0:1789776549.488314:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462066944 00000100:00100000:1.0:1789776549.488406:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 104 00000100:00100000:1.0:1789776549.488418:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bfeb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+50:10528:x1876716462066944:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:1.0:1789776549.488455:0:8177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776549.488459:0:8177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789776549.488494:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8ef7c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c282e expref: 50 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.488521:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c8682cbe900) 00010000:00010000:1.0:1789776549.488528:0:8177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789776549.488563:0:8177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef845 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2851 expref: -99 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.488695:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef84c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.488708:0:8177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef830 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c284a expref: 50 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.488715:0:8177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef84c lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.488754:0:8177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef830 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c284a expref: 50 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.488769:0:8177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef830 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c284a expref: 50 pid: 5811 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776549.488787:0:8177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7bd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8177:1876716471519616:192.168.202.6@tcp:104: 00000100:00100000:1.0:1789776549.488926:0:8177:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bc8f6840 going to sleep for 11 seconds 00000100:00100000:1.0:1789776549.493854:0:8177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7bd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8177:1876716471519616:192.168.202.6@tcp:104: 00010000:00010000:1.0:1789776549.493908:0:8177:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef84c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776549.501931:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776549.502109:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462067072 00000100:00100000:2.0:1789776549.502125:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462067072 00010000:00010000:2.0:1789776549.502186:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef830 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c284a expref: 51 pid: 5811 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776549.502292:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 52 00000100:00100000:2.0:1789776549.502494:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bfeb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0795fb8a-e14a-4768-806c-f332ad101de7+51:2357:x1876716462067072:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789776549.502515:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776549.502530:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef830 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c284a expref: 51 pid: 5811 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776549.502547:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef830 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c284a expref: 51 pid: 5811 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776549.502576:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef830 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c284a expref: 51 pid: 5811 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776549.502597:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c8683789400) 00010000:00010000:2.0:1789776549.502624:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef84c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776549.502636:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef84c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776549.502646:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef84c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776549.502682:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776549.502765:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bfeb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0795fb8a-e14a-4768-806c-f332ad101de7+50:2357:x1876716462067072:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 275us (850us total) trans 0 rc 0/0 00010000:00010000:1.0:1789776549.502824:0:8177:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef84c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.502833:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef84c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776549.502869:0:8177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789776549.503088:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef845 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2851 expref: 52 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.503119:0:8177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef84c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2851 expref: 51 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.503126:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c8683789400) 00010000:00010000:1.0:1789776549.503129:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789776549.503132:0:8177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86bf5caa00, rc 0) 00000100:00100000:1.0:1789776549.503163:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bfeb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+51:10528:x1876716462066944:12345-192.168.202.6@tcp:101:bash.0 Request processed in 14748us (15026us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1789776549.503171:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 104 00000100:00100000:3.0:1789776549.507300:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776549.507338:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462067328 00000100:00100000:1.0:1789776549.507353:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462067328 00000100:00100000:1.0:1789776549.507426:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 105 00000100:00100000:1.0:1789776549.507439:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bfeb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+51:10528:x1876716462067328:12345-192.168.202.6@tcp:36:bash.0 00010000:00010000:1.0:1789776549.507821:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cba00/0x26940258de8ef85a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.507845:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cba00/0x26940258de8ef85a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.507860:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cba00/0x26940258de8ef85a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789776549.507932:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1789776549.507982:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000058be85f2 reply state 0000000008913554 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cba00/0x26940258de8ef85a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776549.507994:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789776549.508146:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bfeb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+54:10528:x1876716462067328:12345-192.168.202.6@tcp:36:bash.0 Request processed in 709us (860us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1789776549.508156:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 105 00000020:00080000:1.0:1789776549.508163:0:5812:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789776549.510590:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 52 00010000:00010000:2.0:1789776549.511602:0:3260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cba00/0x26940258de8ef85a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776549.511619:0:3260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cba00/0x26940258de8ef85a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776549.511627:0:3260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cba00/0x26940258de8ef85a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776549.511634:0:3260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5cba00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776549.511640:0:3260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cba00/0x26940258de8ef85a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776549.511650:0:3260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cba00/0x26940258de8ef85a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776549.511674:0:3260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c8683789400) 00010000:00010000:2.0:1789776549.511677:0:3260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776549.511683:0:3260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cba00/0x26940258de8ef85a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776549.511711:0:3260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cba00/0x26940258de8ef85a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776549.523923:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776549.527029:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462067456 00000100:00100000:0.0:1789776549.527134:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462067456 00000100:00100000:0.0:1789776549.527261:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 106 00000100:00100000:0.0:1789776549.527276:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+52:10528:x1876716462067456:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:0.0:1789776549.527712:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776549.527882:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef861 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2858 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.528007:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef868 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.528258:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef84c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2851 expref: 53 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.528272:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef868 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.528386:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef84c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2851 expref: 53 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.528406:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef84c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2851 expref: 53 pid: 8177 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776549.528425:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c8689394700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1876716471519744:192.168.202.6@tcp:104: 00000100:00100000:0.0:1789776549.528724:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86903e6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789776549.537186:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776549.537863:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462067584 00000100:00100000:1.0:1789776549.537880:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462067584 00010000:00010000:1.0:1789776549.537945:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef84c lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2851 expref: 54 pid: 8177 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776549.538000:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 53 00000100:00100000:1.0:1789776549.538012:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0795fb8a-e14a-4768-806c-f332ad101de7+54:2356:x1876716462067584:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776549.538034:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776549.538043:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef84c lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2851 expref: 54 pid: 8177 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.538076:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef84c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2851 expref: 54 pid: 8177 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.538118:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c8683789400) 00010000:00010000:1.0:1789776549.538125:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef868 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.538137:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef868 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.538146:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef868 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.538195:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776549.538315:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0795fb8a-e14a-4768-806c-f332ad101de7+54:2356:x1876716462067584:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 305us (1826us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776549.538324:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 53 00010000:00010000:0.0:1789776549.540945:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef84c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2851 expref: 53 pid: 8177 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776549.540977:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c8689394700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1876716471519744:192.168.202.6@tcp:104: 00010000:00010000:0.0:1789776549.541010:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef868 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.541021:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef868 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.541027:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef868 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776549.541707:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789776549.541736:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789776549.541784:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef868 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.541830:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef861 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2858 expref: 53 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.541849:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef868 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2858 expref: 52 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.541859:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c8683789400) 00010000:00010000:0.0:1789776549.541862:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789776549.541867:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86b9b09000, rc 0) 00000100:00100000:0.0:1789776549.541961:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+52:10528:x1876716462067456:12345-192.168.202.6@tcp:101:bash.0 Request processed in 14688us (18054us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776549.541972:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 106 00000100:00100000:3.0:1789776549.550970:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776549.556710:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462067840 00000100:00100000:2.0:1789776549.556733:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462067840 00000100:00100000:2.0:1789776549.556913:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 29 00000100:00100000:2.0:1789776549.556926:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+52:10528:x1876716462067840:12345-192.168.202.6@tcp:35:bash.0 00000100:00100000:2.0:1789776549.557351:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+53:10528:x1876716462067840:12345-192.168.202.6@tcp:35:bash.0 Request processed in 427us (6397us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1789776549.557361:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 29 00000100:00100000:3.0:1789776549.630525:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776549.630717:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462067968 00000100:00100000:1.0:1789776549.630734:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462067968 00000100:00100000:1.0:1789776549.630836:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 107 00000100:00100000:1.0:1789776549.630849:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+53:10534:x1876716462067968:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1789776549.630885:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776549.630914:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef86f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c285f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.631011:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef876 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.631031:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef876 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.631046:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef876 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776549.631105:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789776549.631110:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789776549.631134:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef876 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.631165:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef86f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c285f expref: 55 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.631210:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef876 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c285f expref: 54 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.631302:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c8682cbe900) 00010000:00010000:1.0:1789776549.631306:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789776549.631311:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86bf5caa00, rc 0) 00000100:00100000:1.0:1789776549.631394:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+54:10534:x1876716462067968:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 547us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776549.631403:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 107 00000100:00100000:3.0:1789776549.633637:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776549.633945:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462068096 00000100:00100000:1.0:1789776549.633957:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462068096 00000100:00100000:1.0:1789776549.634019:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 108 00000100:00100000:1.0:1789776549.634031:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+54:10534:x1876716462068096:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1789776549.634554:0:8177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776549.634585:0:8177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cba00/0x26940258de8ef87d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2866 expref: -99 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.634686:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef884 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.634711:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef884 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.634727:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef884 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.634751:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8ef88b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.634778:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8ef88b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.634786:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8ef88b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.634959:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8ef892 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.634970:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8ef892 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.634978:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8ef892 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776549.635172:0:8177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789776549.635177:0:8177:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789776549.635209:0:8177:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8ef892 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.635363:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8ef892 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.635373:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef884 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.635380:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef884 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.635388:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef884 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.635410:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5cbc00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776549.635415:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef884 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.635424:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef884 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.635440:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c8682cbe900) 00010000:00010000:1.0:1789776549.635444:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776549.635450:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef884 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.635457:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef884 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.635472:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8ef88b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.635478:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8ef88b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.635484:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8ef88b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.635490:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5ca600 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776549.635493:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8ef88b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.635499:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8ef88b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.635518:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c8683789500) 00010000:00010000:1.0:1789776549.635521:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776549.635524:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8ef88b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.635531:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8ef88b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.635587:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cba00/0x26940258de8ef87d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2866 expref: 56 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.635603:0:8177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8ef892 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2866 expref: 55 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.635612:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c8683789400) 00010000:00010000:1.0:1789776549.635614:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789776549.635617:0:8177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86bf5cae00, rc 0) 00000100:00100000:1.0:1789776549.635732:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+55:10534:x1876716462068096:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 1701us (2108us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776549.635743:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 108 00000100:00100000:2.0:1789776549.642069:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776549.642166:0:11142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462068224 00000100:00100000:0.0:1789776549.642183:0:11142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462068224 00000100:00100000:0.0:1789776549.642324:0:11142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 7 00000100:00100000:0.0:1789776549.642339:0:11142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0795fb8a-e14a-4768-806c-f332ad101de7+55:2355:x1876716462068224:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789776549.642364:0:11142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776549.642402:0:11142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8ef892 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2866 expref: 55 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.642428:0:11142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c8683789400) 00010000:00010000:0.0:1789776549.642435:0:11142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776549.642530:0:11142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0795fb8a-e14a-4768-806c-f332ad101de7+54:2355:x1876716462068224:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 194us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776549.642564:0:11142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 7 00000100:00100000:3.0:1789776549.643102:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776549.643311:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462068480 00000100:00100000:1.0:1789776549.643319:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462068480 00000100:00100000:1.0:1789776549.643368:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 109 00000100:00100000:1.0:1789776549.643377:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+54:10534:x1876716462068480:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1789776549.643401:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776549.643422:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef899 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c286d expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.643586:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef8a0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.643605:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef868 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2858 expref: 55 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.643616:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef8a0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.643660:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef868 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2858 expref: 55 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.643675:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef868 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2858 expref: 55 pid: 5811 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776549.643692:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7bd500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1876716471519872:192.168.202.6@tcp:104: 00000100:00100000:1.0:1789776549.643804:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bc8f63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776549.650996:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776549.651259:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7bd500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1876716471519872:192.168.202.6@tcp:104: 00010000:00010000:1.0:1789776549.651308:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef8a0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776549.651445:0:11143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462068608 00000100:00100000:0.0:1789776549.651457:0:11143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462068608 00010000:00010000:0.0:1789776549.651523:0:11143:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef868 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2858 expref: 56 pid: 5811 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776549.651568:0:11143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 54 00000100:00100000:0.0:1789776549.651580:0:11143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8698809450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0795fb8a-e14a-4768-806c-f332ad101de7+56:2356:x1876716462068608:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789776549.651599:0:11143:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776549.651607:0:11143:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef868 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2858 expref: 56 pid: 5811 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.651621:0:11143:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef868 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2858 expref: 56 pid: 5811 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.651648:0:11143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef868 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2858 expref: 56 pid: 5811 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.651666:0:11143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c8683789400) 00010000:00010000:0.0:1789776549.651671:0:11143:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef8a0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.651681:0:11143:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef8a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.651689:0:11143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef8a0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.651743:0:11143:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776549.651817:0:11143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8698809450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0795fb8a-e14a-4768-806c-f332ad101de7+55:2356:x1876716462068608:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 238us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776549.651826:0:11143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 54 00010000:00010000:1.0:1789776549.652068:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef8a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.652077:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef8a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776549.652115:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789776549.652381:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef899 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c286d expref: 56 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.652400:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef8a0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c286d expref: 55 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.652408:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c8683789400) 00010000:00010000:1.0:1789776549.652411:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789776549.652414:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86bf5cb400, rc 0) 00000100:00100000:1.0:1789776549.652447:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+55:10534:x1876716462068480:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 9072us (9358us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1789776549.652455:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 109 00000100:00100000:0.0:1789776549.657793:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776549.657885:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462068864 00000100:00100000:1.0:1789776549.657900:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462068864 00000100:00100000:1.0:1789776549.657992:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 8 00000100:00100000:1.0:1789776549.658005:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8689394700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0795fb8a-e14a-4768-806c-f332ad101de7+55:10534:x1876716462068864:12345-192.168.202.6@tcp:103:lfs.0 00010000:00010000:1.0:1789776549.658029:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776549.658076:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef7ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2843 expref: 55 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.658109:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c8683789400) 00010000:00010000:1.0:1789776549.658116:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776549.658195:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8689394700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0795fb8a-e14a-4768-806c-f332ad101de7+54:10534:x1876716462068864:12345-192.168.202.6@tcp:103:lfs.0 Request processed in 193us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776549.658203:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 8 00000100:00100000:3.0:1789776549.667648:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776549.667751:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462068992 00000100:00100000:0.0:1789776549.667767:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462068992 00000100:00100000:0.0:1789776549.667853:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 110 00000100:00100000:0.0:1789776549.667866:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+54:10534:x1876716462068992:12345-192.168.202.6@tcp:58:lfs.0 00010000:00010000:0.0:1789776549.668005:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef8ae lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.668027:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef8ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.668041:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef8ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789776549.668353:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1789776549.668477:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+54:10534:x1876716462068992:12345-192.168.202.6@tcp:58:lfs.0 Request processed in 611us (1262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776549.668488:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 110 00000100:00100000:2.0:1789776549.671883:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776549.672625:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462069120 00000100:00100000:3.0:1789776549.672640:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462069120 00000100:00100000:3.0:1789776549.672721:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 111 00000100:00100000:3.0:1789776549.672733:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+54:10534:x1876716462069120:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1789776549.672760:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776549.672789:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678c00/0x26940258de8ef8b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2874 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776549.672867:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef8ae lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776549.672881:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678c00/0x26940258de8ef8b5 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2874 expref: 55 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776549.672923:0:5813:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef8ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776549.672940:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678c00/0x26940258de8ef8b5 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2874 expref: 55 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776549.672957:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c8683789400) 00010000:00010000:3.0:1789776549.672961:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789776549.672965:0:5813:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678c00/0x26940258de8ef8b5 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2874 expref: 55 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776549.672974:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8681678c00, rc 0) 00000100:00100000:3.0:1789776549.674419:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+55:10534:x1876716462069120:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 1677us (2540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776549.674433:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 111 00010000:00010000:3.0:1789776549.780585:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789776549.908491:0:11658:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789776549.908504:0:11658:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789776549.908549:0:11658:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1789776549.908556:0:11658:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789776549.908710:0:11658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86af5e3b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11658:1876716471520000:192.168.202.6@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789776549.908868:0:11658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8682e95900 going to sleep for 11 seconds 00000100:00100000:2.0:1789776549.913790:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776549.914008:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462069248 00000100:00100000:0.0:1789776549.914022:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462069248 00000100:00100000:0.0:1789776549.914117:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 112 00000100:00100000:0.0:1789776549.914129:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+56:10535:x1876716462069248:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789776549.914174:0:5811:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789776549.914374:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+56:10535:x1876716462069248:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 Request processed in 246us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776549.914382:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 112 00000100:00100000:3.0:1789776549.917880:0:11658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86af5e3b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11658:1876716471520000:192.168.202.6@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789776549.922199:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776549.922377:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462069376 00000100:00100000:1.0:1789776549.922390:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462069376 00000100:00100000:1.0:1789776549.922484:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 113 00000100:00100000:1.0:1789776549.922497:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8689395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+55:10535:x1876716462069376:12345-192.168.202.6@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789776549.922603:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef8bc lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.922627:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef8bc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.922643:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef8bc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.929893:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef8c3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.930088:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef8c3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.930113:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef8c3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.930151:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cba00/0x26940258de8ef8ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.930162:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cba00/0x26940258de8ef8ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.930169:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cba00/0x26940258de8ef8ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776549.930248:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789776549.930254:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789776549.930269:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cba00/0x26940258de8ef8ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.930296:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef8bc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.930301:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef8bc lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.930307:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef8bc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.930314:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5cb600 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776549.930318:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef8bc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.930325:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef8bc lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.930337:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c8683789100) 00010000:00010000:1.0:1789776549.930340:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776549.930344:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef8bc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.930351:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef8bc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.930365:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef8c3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.930371:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef8c3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.930376:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef8c3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.930388:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5ca400 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776549.930391:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef8c3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.930398:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef8c3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.930406:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9c8683789500) 00010000:00010000:1.0:1789776549.930411:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776549.930418:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef8c3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.930424:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef8c3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.930446:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cba00/0x26940258de8ef8ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.930453:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cba00/0x26940258de8ef8ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.930459:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cba00/0x26940258de8ef8ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.930464:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5cba00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776549.930467:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cba00/0x26940258de8ef8ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.930473:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cba00/0x26940258de8ef8ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.930506:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c8683789400) 00010000:00010000:1.0:1789776549.930510:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776549.930514:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cba00/0x26940258de8ef8ca lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.930521:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cba00/0x26940258de8ef8ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776549.930633:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8689395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+55:10535:x1876716462069376:12345-192.168.202.6@tcp:34:lhsmtool_posix.0 Request processed in 8135us (8444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776549.930643:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 113 00000100:00100000:2.0:1789776549.936602:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776549.936702:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462069632 00000100:00100000:0.0:1789776549.936718:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462069632 00000100:00100000:0.0:1789776549.936804:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 114 00000100:00100000:0.0:1789776549.936816:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bff63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+55:10535:x1876716462069632:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789776549.936840:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776549.936865:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef8d1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c287b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.937261:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef8d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.937278:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef8d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.937289:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef8d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776549.937302:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789776549.937403:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef8d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.937411:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef8d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.937418:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef8d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.937442:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b08e00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776549.937446:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef8d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.937454:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef8d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.937466:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c8683789400) 00010000:00010000:0.0:1789776549.937469:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789776549.937474:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef8d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.937481:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef8d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.937534:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef8d1 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c287b expref: 57 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.937546:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c8683789100) 00010000:00010000:0.0:1789776549.937548:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789776549.937552:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef8d1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c287b expref: 57 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.937561:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86b9b08400, rc 0) 00000100:00100000:0.0:1789776549.937636:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bff63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+56:10535:x1876716462069632:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 823us (1050us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1789776549.937645:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 114 00000100:00100000:2.0:1789776549.945910:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776549.946000:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462069760 00000100:00100000:3.0:1789776549.946014:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462069760 00000100:00100000:3.0:1789776549.946114:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 115 00000100:00100000:3.0:1789776549.946147:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bff61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+56:10535:x1876716462069760:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789776549.946197:0:5813:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789776549.946792:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bff61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+56:10535:x1876716462069760:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 Request processed in 643us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776549.946803:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 115 00000100:00100000:3.0:1789776549.955512:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776549.955628:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462070016 00000100:00100000:1.0:1789776549.955644:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462070016 00000100:00100000:1.0:1789776549.955724:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 116 00000100:00100000:1.0:1789776549.955737:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+56:10535:x1876716462070016:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789776549.955760:0:8177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776549.955764:0:8177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789776549.955794:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef876 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c285f expref: 56 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.955815:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c8682cbe900) 00010000:00010000:1.0:1789776549.955821:0:8177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789776549.955838:0:8177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cba00/0x26940258de8ef8e6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2882 expref: -99 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789776549.956463:0:8177:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1789776549.957143:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef8ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.957167:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef8ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.957179:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef8ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.957390:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cba00/0x26940258de8ef8e6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2882 expref: 58 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.957408:0:8177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef8ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2882 expref: 57 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.957417:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c8683789500) 00010000:00010000:1.0:1789776549.957420:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789776549.957424:0:8177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86bf5ca400, rc 0) 00000100:00100000:1.0:1789776549.957620:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+57:10535:x1876716462070016:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 1884us (2122us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1789776549.957629:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 116 00000100:00100000:3.0:1789776549.964433:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776549.964547:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462070272 00000100:00100000:1.0:1789776549.964560:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462070272 00000100:00100000:1.0:1789776549.964636:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 117 00000100:00100000:1.0:1789776549.964648:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+57:10535:x1876716462070272:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789776549.964735:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776549.964777:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8ef8ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2882 expref: 57 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.964801:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c8683789500) 00010000:00010000:1.0:1789776549.965158:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789776549.965190:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef8fb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.965207:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef8fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.965268:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef8fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.968044:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef902 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x3081122f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.968075:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef902 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x3081122f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.968087:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef902 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x3081122f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.968913:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef8fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.968925:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef8fb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.968932:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef8fb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.968938:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5caa00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776549.968943:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef8fb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.968951:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef8fb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.968983:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c8682cbe900) 00010000:00010000:1.0:1789776549.968986:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776549.968992:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef8fb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.968997:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8ef8fb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.969013:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef902 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x3081122f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.969019:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef902 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3081122f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.969024:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef902 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3081122f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.969028:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5cb600 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776549.969031:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef902 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3081122f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.969037:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef902 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3081122f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.969044:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x3081122f (ffff9c8683789600) 00010000:00010000:1.0:1789776549.969046:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776549.969049:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef902 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x3081122f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776549.969054:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8ef902 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x3081122f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776549.970193:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+56:10535:x1876716462070272:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 Request processed in 5541us (5768us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789776549.970205:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 117 00000100:00100000:2.0:1789776549.978981:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776549.979353:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462070400 00000100:00100000:0.0:1789776549.979376:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462070400 00000100:00100000:0.0:1789776549.979711:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 118 00000100:00100000:0.0:1789776549.979722:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bff61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+56:10535:x1876716462070400:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789776549.979752:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776549.979787:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef909 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2889 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.979828:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef910 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.979841:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef910 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.979852:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef910 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.979953:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8ef909 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2889 expref: 58 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.979970:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef910 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2889 expref: 57 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.979979:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c86a08dfd00) 00010000:00010000:0.0:1789776549.979982:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789776549.979985:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86b9b08e00, rc 0) 00000100:00100000:0.0:1789776549.980049:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bff61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+57:10535:x1876716462070400:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 330us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776549.980056:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 118 00000100:00100000:3.0:1789776549.987893:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776549.988046:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462070656 00000100:00100000:2.0:1789776549.988058:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462070656 00000100:00100000:2.0:1789776549.989798:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 119 00000100:00100000:2.0:1789776549.989822:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+57:10535:x1876716462070656:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789776549.989921:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8ef917 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776549.989962:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8ef917 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776549.989974:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8ef917 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789776549.990270:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1789776549.990279:0:5813:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 302770062198ns, next at 303770059986ns, rc = 0 00000004:00010000:2.0:1789776549.990373:0:5813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b52871cb reply state 000000003bb2f264 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8ef917 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776549.990382:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789776549.991840:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+59:10535:x1876716462070656:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 Request processed in 2021us (3950us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1789776549.991851:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 119 00010000:00010000:0.0:1789776549.995907:0:3259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8ef917 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.995933:0:3259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8ef917 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.995938:0:3259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8ef917 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.995942:0:3259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8686774200 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776549.995945:0:3259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8ef917 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.995951:0:3259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8ef917 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.995966:0:3259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c86a08dfd00) 00010000:00010000:0.0:1789776549.995967:0:3259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789776549.995971:0:3259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8ef917 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776549.995975:0:3259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8ef917 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776549.998734:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776549.999911:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462070784 00000100:00100000:2.0:1789776549.999924:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462070784 00000100:00100000:2.0:1789776550.000031:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 120 00000100:00100000:2.0:1789776550.000043:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+58:10535:x1876716462070784:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789776550.000073:0:8177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776550.000113:0:8177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774800/0x26940258de8ef91e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2890 expref: -99 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.000182:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774800/0x26940258de8ef91e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2890 expref: 59 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.000198:0:8177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774800/0x26940258de8ef91e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2890 expref: 59 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.000257:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c86a08dfd00) 00010000:00010000:2.0:1789776550.000260:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789776550.000265:0:8177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8686774800, rc 0) 00000100:00100000:2.0:1789776550.000339:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+59:10535:x1876716462070784:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 298us (1613us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776550.000345:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 120 00000100:00100000:2.0:1789776550.006646:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776550.006723:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462070912 00000100:00100000:3.0:1789776550.006733:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462070912 00000100:00100000:3.0:1789776550.006827:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 37 00000100:00100000:3.0:1789776550.006838:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bff62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+8:2354:x1876716462070912:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1789776550.007365:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789776550.007541:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bff62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+9:2354:x1876716462070912:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 Request processed in 704us (904us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789776550.007552:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 37 00000100:00100000:3.0:1789776550.013453:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776550.013551:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462071168 00000100:00100000:1.0:1789776550.013564:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462071168 00000100:00100000:1.0:1789776550.013627:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 30 00000100:00100000:1.0:1789776550.013638:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+59:10535:x1876716462071168:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789776550.013929:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+60:10535:x1876716462071168:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 Request processed in 292us (486us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1789776550.013938:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 30 00000100:00100000:0.0:1789776550.019363:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776550.019464:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462071424 00000100:00100000:2.0:1789776550.019476:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462071424 00000100:00100000:2.0:1789776550.019539:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 121 00000100:00100000:2.0:1789776550.019549:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8689396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+60:10535:x1876716462071424:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789776550.019693:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8689396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+60:10535:x1876716462071424:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 145us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776550.019701:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 121 00000100:00100000:3.0:1789776550.025513:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776550.025623:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462071552 00000100:00100000:0.0:1789776550.025633:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462071552 00000100:00100000:0.0:1789776550.025748:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 122 00000100:00100000:0.0:1789776550.025759:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+60:10535:x1876716462071552:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789776550.025788:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776550.025811:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09e00/0x26940258de8ef925 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2897 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776550.025922:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09600/0x26940258de8ef92c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776550.025937:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09600/0x26940258de8ef92c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776550.025948:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09600/0x26940258de8ef92c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776550.025986:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789776550.026005:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09600/0x26940258de8ef92c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776550.026030:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09e00/0x26940258de8ef925 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2897 expref: 62 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776550.026048:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09600/0x26940258de8ef92c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2897 expref: 61 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776550.026057:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c86a08dfd00) 00010000:00010000:0.0:1789776550.026060:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789776550.026064:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86b9b09600, rc 0) 00000100:00100000:0.0:1789776550.026149:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+61:10535:x1876716462071552:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 391us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776550.026156:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 122 00000100:00100000:3.0:1789776550.029456:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776550.031347:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462071680 00000100:00100000:0.0:1789776550.031364:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462071680 00000100:00100000:0.0:1789776550.031558:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 38 00000100:00100000:0.0:1789776550.031581:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0795fb8a-e14a-4768-806c-f332ad101de7+9:2357:x1876716462071680:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789776550.031598:0:6662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776550.031623:0:6662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcaa9503/0x26940258de8ef933 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c289e expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789776550.031645:0:6662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aadd2a6, blocks: 0x1 00010000:00010000:0.0:1789776550.031665:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=302s v=(0 0) 00010000:00010000:0.0:1789776550.031670:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789776550.031681:0:6662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcaa9503/0x26940258de8ef933 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c289e expref: 10 pid: 6662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776550.031698:0:6662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fcaa9503/0x26940258de8ef933 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c289e expref: 10 pid: 6662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776550.031710:0:6662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86b9b09e00, rc 0) 00000100:00100000:0.0:1789776550.032154:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0795fb8a-e14a-4768-806c-f332ad101de7+10:2357:x1876716462071680:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 561us (2707us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776550.032162:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 38 00000100:00100000:3.0:1789776550.038493:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776550.038912:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462071936 00000100:00100000:2.0:1789776550.038923:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462071936 00000100:00100000:2.0:1789776550.038984:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 123 00000100:00100000:2.0:1789776550.038994:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+61:10535:x1876716462071936:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789776550.039249:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+61:10535:x1876716462071936:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 255us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776550.039258:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 123 00000100:00100000:2.0:1789776550.045255:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776550.045354:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462072064 00000100:00100000:3.0:1789776550.045364:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462072064 00000100:00100000:3.0:1789776550.046047:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 39 00000100:00100000:3.0:1789776550.046061:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf34c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+10:10535:x1876716462072064:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789776550.046083:0:6661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776550.046128:0:6661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008688fcc9/0x26940258de8ef93a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c28a5 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776550.046165:0:6661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fcaa9503/0x26940258de8ef933 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c289e expref: 11 pid: 6662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776550.046189:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789776550.046193:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789776550.046199:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008688fcc9/0x26940258de8ef93a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28a5 expref: 11 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776550.046269:0:6661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fcaa9503/0x26940258de8ef933 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c289e expref: 11 pid: 6662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776550.046284:0:6661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fcaa9503/0x26940258de8ef933 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c289e expref: 11 pid: 6662 timeout: 402 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776550.046298:0:6661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86af5e3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6661:1876716471520128:192.168.202.6@tcp:104: 00000100:00100000:3.0:1789776550.046398:0:6661:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8682e95900 going to sleep for 11 seconds 00000100:00100000:3.0:1789776550.049625:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776550.049797:0:11142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462072192 00000100:00100000:0.0:1789776550.049809:0:11142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462072192 00010000:00010000:0.0:1789776550.049853:0:11142:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fcaa9503/0x26940258de8ef933 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c289e expref: 12 pid: 6662 timeout: 402 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776550.049900:0:11142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 55 00000100:00100000:0.0:1789776550.049910:0:11142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0795fb8a-e14a-4768-806c-f332ad101de7+12:2356:x1876716462072192:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789776550.049928:0:11142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776550.049967:0:11142:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fcaa9503/0x26940258de8ef933 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c289e expref: 12 pid: 6662 timeout: 402 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776550.049982:0:11142:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fcaa9503/0x26940258de8ef933 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c289e expref: 12 pid: 6662 timeout: 402 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776550.050012:0:11142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789776550.050016:0:11142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789776550.050026:0:11142:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008688fcc9/0x26940258de8ef93a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28a5 expref: 12 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776550.050036:0:11142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008688fcc9/0x26940258de8ef93a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28a5 expref: 12 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776550.050078:0:11142:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008688fcc9/0x26940258de8ef93a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28a5 expref: 12 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776550.050103:0:11142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c8689397b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11142:1876716471520256:192.168.202.6@tcp:105: 00000100:00100000:0.0:1789776550.050207:0:11142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8582cae3c0 going to sleep for 11 seconds 00010000:00010000:2.0:1789776550.050381:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcaa9503/0x26940258de8ef933 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c289e expref: 12 pid: 6662 timeout: 402 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776550.050409:0:6661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86af5e3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6661:1876716471520128:192.168.202.6@tcp:104: 00010000:00010000:2.0:1789776550.050433:0:6661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008688fcc9/0x26940258de8ef93a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28a5 expref: 11 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.050457:0:6661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8681678a00, rc 0) 00000100:00100000:2.0:1789776550.050486:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf34c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+11:10535:x1876716462072064:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 4430us (5273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776550.050494:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 39 00000100:00100000:3.0:1789776550.055989:0:11142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c8689397b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11142:1876716471520256:192.168.202.6@tcp:105: 00010000:00010000:3.0:1789776550.056020:0:11142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776550.059730:0:11142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0795fb8a-e14a-4768-806c-f332ad101de7+10:2356:x1876716462072192:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 9809us (10103us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776550.059757:0:11142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 55 00000100:00100000:2.0:1789776550.060719:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776550.061228:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462072320 00000100:00100000:3.0:1789776550.061238:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462072320 00002000:00100000:3.0:1789776550.061287:0:6666:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9c86bf34fb80 x1876716462072320/t0(0) o4->0795fb8a-e14a-4768-806c-f332ad101de7@192.168.202.6@tcp:741/0 lens 504/0 e 0 to 0 dl 1789776561 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789776550.061296:0:6666:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c86bf34fb80 with x1876716462072320 ext(0->12) 00002000:00010000:3.0:1789776550.061316:0:6666:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c86bf34fb80 00000100:00100000:3.0:1789776550.061404:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 2 00000100:00100000:3.0:1789776550.061414:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf34fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0795fb8a-e14a-4768-806c-f332ad101de7+10:2356:x1876716462072320:12345-192.168.202.6@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789776550.062205:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf34fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0795fb8a-e14a-4768-806c-f332ad101de7+12:2356:x1876716462072320:12345-192.168.202.6@tcp:4:lhsmtool_posix.0 Request processed in 790us (1487us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789776550.062291:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 2 00002000:00100000:3.0:1789776550.062302:0:6666:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9c86bf34fb80 x1876716462072320/t4294967308(0) o4->0795fb8a-e14a-4768-806c-f332ad101de7@192.168.202.6@tcp:741/0 lens 504/448 e 0 to 0 dl 1789776561 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789776550.062310:0:6666:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c86bf34fb80 with x1876716462072320 ext(0->12) 00002000:00010000:3.0:1789776550.062316:0:6666:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c86bf34fb80 00000100:00100000:0.0:1789776550.066884:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776550.067100:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462072448 00000100:00100000:2.0:1789776550.067118:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462072448 00000100:00100000:2.0:1789776550.067179:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 124 00000100:00100000:2.0:1789776550.067189:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8689397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+61:10535:x1876716462072448:12345-192.168.202.6@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789776550.218379:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967397 is committed 00000001:00080000:1.0:1789776550.218424:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1789776550.218467:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:1.0:1789776550.218482:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:1.0:1789776550.218497:0:5833:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c86aa6e5e40 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1789776550.218502:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c86aa6f3600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c86aa6e5cc0 00000020:00080000:1.0:1789776550.218506:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c86aa6f3000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c86bb58d000 00000020:00080000:1.0:1789776550.219255:0:5844:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1789776550.219275:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471520384:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789776550.219285:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471520640:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789776550.219403:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776550.219503:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789776550.219510:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471520512:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789776550.219532:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1789776550.222406:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1789776550.222439:0:5833:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c8682e95f00 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1789776550.222444:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c86bf326a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c8682e956c0 00000020:00080000:1.0:1789776550.222447:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c86bf326100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c86ba79cc00 00000020:00080000:1.0:1789776550.222473:0:5844:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:2.0:1789776550.222812:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1789776550.222839:0:5844:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1789776550.222997:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8689397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+15:10535:x1876716462072448:12345-192.168.202.6@tcp:44:lhsmtool_posix.0 Request processed in 155807us (156123us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776550.223006:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 124 00000100:00100000:3.0:1789776550.223303:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471520384 00000100:00100000:3.0:1789776550.223311:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471520384 00000100:00100000:3.0:1789776550.223371:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471520512 00000100:00100000:3.0:1789776550.223374:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471520512 00000100:00100000:3.0:1789776550.223393:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789776550.223401:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3273:x1876716471520384:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789776550.223430:0:6659:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:3.0:1789776550.223457:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c94b769/0x26940258de8ef941 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776550.223481:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d2faab85/0x26940258de8ef703 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2804 expref: 11 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776550.223490:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1789776550.223495:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789776550.223499:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c94b769/0x26940258de8ef941 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776550.223550:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d2faab85/0x26940258de8ef703 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2804 expref: 11 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776550.223564:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d2faab85/0x26940258de8ef703 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2804 expref: 11 pid: 6662 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776550.223579:0:6659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86af5e1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6659:1876716471520768:192.168.202.6@tcp:104: 00000100:00080000:1.0:1789776550.223839:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789776550.224818:0:6659:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86b9d5ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1789776550.224847:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789776550.224862:0:8384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3273:x1876716471520512:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1789776550.225044:0:8384:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789776550.225049:0:8384:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789776550 00002000:00010000:3.0:1789776550.225051:0:8384:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789776550.225053:0:8384:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789776550 -> 1789776550 00002000:00010000:3.0:1789776550.225055:0:8384:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789776550.225277:0:8384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3273:x1876716471520512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 420us (5743us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789776550.225285:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789776550.229300:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471520640 00000100:00100000:0.0:1789776550.229316:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471520640 00000100:00100000:0.0:1789776550.229374:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789776550.229384:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf34d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3275:x1876716471520640:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789776550.229418:0:6662:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:0.0:1789776550.229452:0:6662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aadd2a5, atime: 0x6aadd2a5, ctime: 0x6aadd2a5, blocks: 0x1 00010000:00010000:0.0:1789776550.229475:0:6662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e4584c3/0x26940258de8ef948 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776550.229492:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=303s v=(0 0) 00010000:00010000:0.0:1789776550.229496:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789776550.229503:0:6662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e4584c3/0x26940258de8ef948 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776550.229519:0:6662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e4584c3/0x26940258de8ef948 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776550.229529:0:6662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e4584c3/0x26940258de8ef948 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776550.229538:0:6662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e4584c3/0x26940258de8ef948 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776550.229569:0:6662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789776550.230448:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf34d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3275:x1876716471520640:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1063us (7636us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789776550.230458:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:2.0:1789776550.230554:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776550.230563:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e4584c3/0x26940258de8ef948 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.230574:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b09200 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:2.0:1789776550.230578:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e4584c3/0x26940258de8ef948 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.230600:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e4584c3/0x26940258de8ef948 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.230621:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e4584c3/0x26940258de8ef948 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.230630:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e4584c3/0x26940258de8ef948 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.230650:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776550.230652:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776550.230653:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789776550.230695:0:3275:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c86bf7bc700/2, rc 0, transno 4294967304 00000100:00100000:2.0:1789776550.230702:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471520640:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1789776550.231488:0:3273:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c86bf7bdc00/2, rc 0, transno 4294967309 00000100:00100000:2.0:1789776550.231496:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471520512:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789776550.242538:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776550.245929:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462072576 00000100:00100000:3.0:1789776550.245946:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462072576 00000100:00100000:3.0:1789776550.246022:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 43 00000100:00100000:3.0:1789776550.246033:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bfeb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+12:2357:x1876716462072576:12345-192.168.202.6@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789776550.257307:0:6659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86af5e1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6659:1876716471520768:192.168.202.6@tcp:104: 00010000:00010000:0.0:1789776550.257339:0:6659:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009c94b769/0x26940258de8ef941 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776550.258809:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776550.259027:0:11143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462072704 00000100:00100000:2.0:1789776550.259037:0:11143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462072704 00010000:00010000:2.0:1789776550.259075:0:11143:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d2faab85/0x26940258de8ef703 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2804 expref: 13 pid: 6662 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776550.259132:0:11143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 56 00000100:00100000:2.0:1789776550.259894:0:11143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bfeb3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0795fb8a-e14a-4768-806c-f332ad101de7+13:2356:x1876716462072704:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789776550.259915:0:11143:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776550.259931:0:11143:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d2faab85/0x26940258de8ef703 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2804 expref: 13 pid: 6662 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.259947:0:11143:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d2faab85/0x26940258de8ef703 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2804 expref: 13 pid: 6662 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.259974:0:11143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2faab85/0x26940258de8ef703 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2804 expref: 13 pid: 6662 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.259990:0:11143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789776550.259994:0:11143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789776550.260000:0:11143:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009c94b769/0x26940258de8ef941 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.260010:0:11143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c94b769/0x26940258de8ef941 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.260043:0:11143:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776550.260103:0:11143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bfeb3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0795fb8a-e14a-4768-806c-f332ad101de7+12:2356:x1876716462072704:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 962us (1303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776550.260213:0:11143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 56 00010000:00010000:0.0:1789776550.260315:0:6659:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009c94b769/0x26940258de8ef941 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776550.260325:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c94b769/0x26940258de8ef941 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776550.260335:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c94b769/0x26940258de8ef941 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776550.260343:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c94b769/0x26940258de8ef941 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776550.260363:0:6659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789776550.260680:0:8421:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776550.260687:0:8421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c94b769/0x26940258de8ef941 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.260696:0:8421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681679400 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:2.0:1789776550.260700:0:8421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c94b769/0x26940258de8ef941 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.260716:0:8421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c94b769/0x26940258de8ef941 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.260729:0:8421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c94b769/0x26940258de8ef941 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.260736:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c94b769/0x26940258de8ef941 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.260754:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776550.260756:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776550.260757:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776550.261118:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3273:x1876716471520384:12345-0@lo:6:osp-syn-0-0.0 Request processed in 37715us (41713us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789776550.261126:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:2.0:1789776550.261273:0:3273:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c86bf7bd500/2, rc 0, transno 4294967310 00000100:00100000:2.0:1789776550.261281:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471520384:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789776550.297295:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bfeb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471520896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789776550.297369:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776550.301684:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471520896 00000100:00100000:0.0:1789776550.301701:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471520896 00000100:00100000:0.0:1789776550.301791:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789776550.301802:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3276:x1876716471520896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789776550.301828:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789776550.301928:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3276:x1876716471520896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (4558us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776550.301935:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789776550.303883:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bfeb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471520896:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1789776550.339732:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:0.0:1789776550.339778:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:0.0:1789776550.339796:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:0.0:1789776550.339820:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:0.0:1789776550.339949:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bfeb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+6:2357:x1876716462072576:12345-192.168.202.6@tcp:16:lhsmtool_posix.0 Request processed in 93912us (97418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776550.339961:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 43 00000100:00100000:1.0:1789776550.349396:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776550.350410:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462072960 00000100:00100000:3.0:1789776550.350423:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462072960 00000100:00100000:3.0:1789776550.350496:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 125 00000100:00100000:3.0:1789776550.350506:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+15:10535:x1876716462072960:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789776550.350561:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776550.350591:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09600/0x26940258de8ef92c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2897 expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776550.350609:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c86a08dfd00) 00010000:00010000:3.0:1789776550.350615:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789776550.350647:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8ef94f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776550.350662:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8ef94f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776550.350672:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8ef94f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789776550.351317:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005b04ad4c reply state 00000000c84ed48e transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8ef94f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776550.351331:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789776550.351454:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+16:10535:x1876716462072960:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 Request processed in 946us (2064us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1789776550.351465:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 125 00000001:00080000:0.0:1789776550.353075:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:0.0:1789776550.355186:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00010000:00010000:2.0:1789776550.358714:0:3260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8ef94f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.358731:0:3260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8ef94f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.358843:0:3260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8ef94f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.358850:0:3260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681679200 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776550.358855:0:3260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8ef94f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.358880:0:3260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8ef94f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.358898:0:3260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c86a08dfd00) 00010000:00010000:2.0:1789776550.358901:0:3260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776550.358907:0:3260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8ef94f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.358913:0:3260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8ef94f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776550.359958:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776550.360026:0:8384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462073088 00000100:00100000:3.0:1789776550.360037:0:8384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462073088 00000100:00100000:3.0:1789776550.360104:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 44 00000100:00100000:3.0:1789776550.360115:0:8384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0795fb8a-e14a-4768-806c-f332ad101de7+6:2356:x1876716462073088:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789776550.360381:0:8384:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1789776550.360394:0:8384:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789776550 -> 1789776550 00002000:00010000:3.0:1789776550.360397:0:8384:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789776549 00002000:00010000:3.0:1789776550.360400:0:8384:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789776550 -> 1789776550 00002000:00010000:3.0:1789776550.360402:0:8384:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789776550.360456:0:8384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0795fb8a-e14a-4768-806c-f332ad101de7+7:2356:x1876716462073088:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 Request processed in 343us (505us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789776550.360464:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 44 00000100:00100000:0.0:1789776550.363511:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776550.363595:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462073344 00000100:00100000:3.0:1789776550.363607:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462073344 00000100:00100000:3.0:1789776550.363667:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 126 00000100:00100000:3.0:1789776550.363677:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bfeb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+15:10535:x1876716462073344:12345-192.168.202.6@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789776550.363749:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8ef956 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776550.363767:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef910 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2889 expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776550.363949:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8ef956 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776550.363986:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef910 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2889 expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776550.364002:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef910 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2889 expref: 15 pid: 5811 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776550.364025:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86af5e3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1876716471521024:192.168.202.6@tcp:104: 00000100:00100000:3.0:1789776550.364171:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86b9d5c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776550.370456:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86af5e3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1876716471521024:192.168.202.6@tcp:104: 00010000:00010000:3.0:1789776550.370490:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8ef956 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776550.380385:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776550.380673:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462073472 00000100:00100000:1.0:1789776550.380683:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462073472 00010000:00010000:1.0:1789776550.380724:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef910 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2889 expref: 16 pid: 5811 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776550.380782:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 57 00000100:00100000:1.0:1789776550.380792:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0795fb8a-e14a-4768-806c-f332ad101de7+16:2356:x1876716462073472:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776550.380807:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776550.380813:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef910 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2889 expref: 16 pid: 5811 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.380848:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef910 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2889 expref: 16 pid: 5811 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.380870:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef910 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2889 expref: 16 pid: 5811 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.380888:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c86a08dfd00) 00010000:00010000:1.0:1789776550.380893:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8ef956 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.380903:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8ef956 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.380910:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8ef956 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.380945:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789776550.381068:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8ef956 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776550.381077:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8ef956 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776550.381118:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8ef956 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776550.381126:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8ef956 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776550.381134:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8ef956 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776550.381141:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681679c00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776550.381145:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8ef956 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776550.381153:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8ef956 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776550.381163:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c86a08dfd00) 00010000:00010000:0.0:1789776550.381173:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789776550.381178:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8ef956 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776550.381184:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8ef956 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776550.381302:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0795fb8a-e14a-4768-806c-f332ad101de7+15:2356:x1876716462073472:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 510us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776550.381310:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 57 00000100:00100000:0.0:1789776550.383992:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bfeb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+14:10535:x1876716462073344:12345-192.168.202.6@tcp:55:lhsmtool_posix.0 Request processed in 20305us (20480us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789776550.384006:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 126 00000100:00100000:0.0:1789776550.391452:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776550.391549:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462073600 00000100:00100000:3.0:1789776550.391560:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462073600 00000100:00100000:3.0:1789776550.391617:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 45 00000100:00100000:3.0:1789776550.391628:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0795fb8a-e14a-4768-806c-f332ad101de7+7:2354:x1876716462073600:12345-192.168.202.6@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789776550.391674:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000057f050f3/0x26940258de8ef95d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776550.391695:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008688fcc9/0x26940258de8ef93a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28a5 expref: 7 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776550.391703:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789776550.391708:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789776550.391713:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057f050f3/0x26940258de8ef95d lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776550.391760:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008688fcc9/0x26940258de8ef93a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28a5 expref: 7 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776550.391950:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008688fcc9/0x26940258de8ef93a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28a5 expref: 7 pid: 6661 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776550.391970:0:6659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86af5e3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6659:1876716471521152:192.168.202.6@tcp:104: 00000100:00100000:3.0:1789776550.392058:0:6659:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86b9d5c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776550.396368:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776550.396471:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462073728 00000100:00100000:2.0:1789776550.396481:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462073728 00010000:00010000:2.0:1789776550.396523:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008688fcc9/0x26940258de8ef93a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28a5 expref: 8 pid: 6661 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776550.396569:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 58 00000100:00100000:2.0:1789776550.396579:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0795fb8a-e14a-4768-806c-f332ad101de7+8:2356:x1876716462073728:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789776550.396597:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776550.396620:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008688fcc9/0x26940258de8ef93a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28a5 expref: 8 pid: 6661 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.396634:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008688fcc9/0x26940258de8ef93a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28a5 expref: 8 pid: 6661 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.396658:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789776550.396662:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789776550.396682:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000057f050f3/0x26940258de8ef95d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.396693:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057f050f3/0x26940258de8ef95d lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.396714:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776550.396799:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0795fb8a-e14a-4768-806c-f332ad101de7+8:2356:x1876716462073728:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 220us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776550.396806:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 58 00010000:00010000:3.0:1789776550.397272:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008688fcc9/0x26940258de8ef93a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28a5 expref: 7 pid: 6661 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776550.397287:0:6659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86af5e3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6659:1876716471521152:192.168.202.6@tcp:104: 00010000:00010000:3.0:1789776550.397306:0:6659:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000057f050f3/0x26940258de8ef95d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776550.397316:0:6659:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000057f050f3/0x26940258de8ef95d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776550.397324:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057f050f3/0x26940258de8ef95d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776550.397349:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000057f050f3/0x26940258de8ef95d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776550.397358:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057f050f3/0x26940258de8ef95d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776550.397364:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057f050f3/0x26940258de8ef95d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776550.397370:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681678800 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:3.0:1789776550.397374:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057f050f3/0x26940258de8ef95d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776550.397395:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057f050f3/0x26940258de8ef95d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776550.397408:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057f050f3/0x26940258de8ef95d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776550.397415:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057f050f3/0x26940258de8ef95d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776550.397464:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0795fb8a-e14a-4768-806c-f332ad101de7+6:2354:x1876716462073600:12345-192.168.202.6@tcp:1:lhsmtool_posix.0 Request processed in 5839us (6021us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776550.397472:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 45 00000100:00100000:1.0:1789776550.402731:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776550.403202:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462073984 00000100:00100000:3.0:1789776550.403212:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462073984 00000100:00100000:3.0:1789776550.403294:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 127 00000100:00100000:3.0:1789776550.403303:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba20dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+14:10535:x1876716462073984:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789776550.403386:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8ef964 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776550.403404:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8ef964 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776550.403415:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8ef964 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776550.403621:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8ef96b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776550.403640:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774800/0x26940258de8ef91e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2890 expref: 15 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776550.403649:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8ef96b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776550.403683:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774800/0x26940258de8ef91e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2890 expref: 15 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776550.403700:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774800/0x26940258de8ef91e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2890 expref: 15 pid: 8177 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776550.403715:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86af5e3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1876716471521280:192.168.202.6@tcp:104: 00000100:00100000:3.0:1789776550.404163:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86b9d5c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776550.414331:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776550.414453:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462074112 00000100:00100000:2.0:1789776550.414463:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462074112 00010000:00010000:2.0:1789776550.414502:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774800/0x26940258de8ef91e lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2890 expref: 16 pid: 8177 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776550.414544:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 59 00000100:00100000:2.0:1789776550.414555:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf298380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0795fb8a-e14a-4768-806c-f332ad101de7+16:2357:x1876716462074112:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789776550.414571:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776550.414577:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774800/0x26940258de8ef91e lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2890 expref: 16 pid: 8177 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.414590:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774800/0x26940258de8ef91e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2890 expref: 16 pid: 8177 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.414612:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c86a08dfd00) 00010000:00010000:2.0:1789776550.414618:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8ef96b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.414646:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8ef96b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.414654:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8ef96b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.414673:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776550.414730:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf298380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0795fb8a-e14a-4768-806c-f332ad101de7+16:2357:x1876716462074112:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 177us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776550.414747:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 59 00010000:00010000:3.0:1789776550.415406:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774800/0x26940258de8ef91e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2890 expref: 15 pid: 8177 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776550.415423:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86af5e3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1876716471521280:192.168.202.6@tcp:104: 00010000:00010000:3.0:1789776550.415447:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8ef96b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776550.415455:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8ef96b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776550.415462:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8ef96b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789776550.415658:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:3.0:1789776550.415945:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1789776550.415997:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:3.0:1789776550.416084:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86af5e3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5812:1876716471521408:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789776550.416173:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776550.416264:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86ba8c9780 going to sleep for 11 seconds 00000100:00100000:1.0:1789776550.416380:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471521408 00000100:00100000:1.0:1789776550.416386:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471521408 00000100:00100000:1.0:1789776550.416432:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789776550.416441:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5812:x1876716471521408:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789776550.416525:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5812:x1876716471521408:12345-0@lo:1000:mdt00_001.0 Request processed in 84us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776550.416540:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789776550.416575:0:5812:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:1.0:1789776550.416580:0:5812:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:1.0:1789776550.416595:0:5812:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c86bf7bdc00, transno 4294967309 00000100:00100000:1.0:1789776550.416609:0:5812:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9c86bf7bd500 x1876716471520384/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789776566 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776550.416619:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86af5e3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5812:1876716471521408:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1789776550.417186:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1789776550.417280:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba20fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5812:1876716471521536:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789776550.417313:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776550.417331:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86b9d5c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776550.417507:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471521536 00000100:00100000:1.0:1789776550.417512:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471521536 00000100:00100000:1.0:1789776550.417534:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789776550.417541:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba20c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5812:x1876716471521536:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789776550.417685:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba20c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5812:x1876716471521536:12345-0@lo:1000:mdt00_001.0 Request processed in 143us (371us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1789776550.417693:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789776550.417726:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba20fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5812:1876716471521536:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1789776550.417756:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8ef96b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.417766:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8ef96b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.419372:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8ef96b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.419396:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681679000 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776550.419401:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8ef96b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.419410:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8ef96b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.419429:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c86a08dfd00) 00010000:00010000:1.0:1789776550.419432:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789776550.419437:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8ef96b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.419443:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8ef96b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.419483:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef8ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.419489:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef8ae lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.419495:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef8ae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.419499:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b09000 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776550.419501:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef8ae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.419506:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef8ae lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.419525:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c8683789400) 00010000:00010000:1.0:1789776550.419527:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789776550.419534:0:5812:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678c00/0x26940258de8ef8b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2874 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.419544:0:5812:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678c00/0x26940258de8ef8b5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2874 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.419553:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678c00/0x26940258de8ef8b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2874 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.419591:0:5812:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678c00/0x26940258de8ef8b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2874 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776550.419607:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba20ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1876716471521664:192.168.202.6@tcp:105: 00000100:00100000:1.0:1789776550.419749:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86878f09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776550.425355:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba20ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1876716471521664:192.168.202.6@tcp:105: 00010000:00010000:1.0:1789776550.425388:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef8ae lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.425400:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef8ae lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.425436:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8ef972 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.425450:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8ef972 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.425477:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8ef972 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.425488:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8ef972 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.425494:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8ef972 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.425500:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8ef972 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.425506:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5cb200 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776550.425509:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8ef972 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.425516:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8ef972 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.425526:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c8683789400) 00010000:00010000:1.0:1789776550.425529:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776550.425533:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8ef972 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.425538:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8ef972 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.425549:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8ef964 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.425555:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8ef964 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.425567:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8ef964 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.425573:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681678000 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776550.425575:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8ef964 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.425581:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8ef964 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.425589:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c8683789400) 00010000:00010000:1.0:1789776550.425591:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789776550.425594:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8ef964 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.425600:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8ef964 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776550.425863:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba20dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+18:10535:x1876716462073984:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 22558us (23139us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1789776550.425873:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 127 00000020:00080000:1.0:1789776550.425879:0:5812:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789776550.426058:0:11658:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789776550.426063:0:11658:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789776550.426564:0:11658:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1789776550.426574:0:11658:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789776550.426998:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776550.429129:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462074240 00000100:00100000:1.0:1789776550.429146:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462074240 00000100:00100000:1.0:1789776550.429237:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 31 00000100:00100000:1.0:1789776550.429249:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf29b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+18:10534:x1876716462074240:12345-192.168.202.6@tcp:49:lfs.0 00000100:00100000:1.0:1789776550.429397:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf29b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+18:10534:x1876716462074240:12345-192.168.202.6@tcp:49:lfs.0 Request processed in 149us (2400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776550.429421:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 31 00000100:00100000:0.0:1789776550.450570:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776550.450655:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462074496 00000100:00100000:1.0:1789776550.450666:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462074496 00000100:00100000:1.0:1789776550.450727:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 32 00000100:00100000:1.0:1789776550.450738:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a0684c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+18:10535:x1876716462074496:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789776550.451399:0:5814:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789776550.451486:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1789776550.451525:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8ef979 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.451540:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8ef979 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.451551:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8ef979 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.451559:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8ef979 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.451567:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8ef979 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.451573:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8ef979 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.451594:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789776550.451681:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a0684c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+20:10535:x1876716462074496:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 Request processed in 944us (1121us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1789776550.451690:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 32 00000020:00080000:1.0:1789776550.451701:0:5814:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789776550.452260:0:8420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789776550.452268:0:8420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8ef979 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776550.452276:0:8420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5cb200 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:3.0:1789776550.452281:0:8420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8ef979 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776550.452289:0:8420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8ef979 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776550.452302:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c8683789300) 00010000:00010000:3.0:1789776550.452305:0:8420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789776550.452310:0:8420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8ef979 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776550.452316:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8ef979 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776550.452338:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776550.452340:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776550.452341:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776550.455441:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776550.455557:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462074752 00000100:00100000:1.0:1789776550.455566:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462074752 00000100:00100000:1.0:1789776550.455628:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 128 00000100:00100000:1.0:1789776550.455639:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf29a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+20:10534:x1876716462074752:12345-192.168.202.6@tcp:58:lfs.0 00000040:00080000:1.0:1789776550.456198:0:8177:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1789776550.457002:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf29a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+20:10534:x1876716462074752:12345-192.168.202.6@tcp:58:lfs.0 Request processed in 1360us (1565us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776550.457015:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 128 00000100:00100000:0.0:1789776550.509558:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776550.509661:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462074880 00000100:00100000:2.0:1789776550.509671:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462074880 00000100:00100000:2.0:1789776550.509735:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 129 00000100:00100000:2.0:1789776550.509754:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf29b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+20:10537:x1876716462074880:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1789776550.510505:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776550.510534:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774000/0x26940258de8ef980 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c28ac expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.510598:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775e00/0x26940258de8ef987 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.510614:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775e00/0x26940258de8ef987 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.510627:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775e00/0x26940258de8ef987 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.510641:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775600/0x26940258de8ef98e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.510666:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775600/0x26940258de8ef98e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.510673:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775600/0x26940258de8ef98e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.510927:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775400/0x26940258de8ef995 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.510940:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef8a0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c286d expref: 21 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.510949:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775400/0x26940258de8ef995 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.510984:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef8a0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c286d expref: 21 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.511001:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef8a0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c286d expref: 21 pid: 5812 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776550.511016:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1876716471521792:192.168.202.6@tcp:104: 00000100:00100000:2.0:1789776550.511127:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8690681f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789776550.514495:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1876716471521792:192.168.202.6@tcp:104: 00010000:00010000:2.0:1789776550.514525:0:5813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775400/0x26940258de8ef995 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776550.515023:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776550.515111:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462075136 00000100:00100000:1.0:1789776550.515119:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462075136 00000100:00100000:1.0:1789776550.515172:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 33 00000100:00100000:1.0:1789776550.515183:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+22:5596:x1876716462075136:12345-192.168.202.6@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789776550.515569:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+23:5596:x1876716462075136:12345-192.168.202.6@tcp:35:ldlm_bl.0 Request processed in 387us (546us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1789776550.515578:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 33 00000100:00100000:0.0:1789776550.520194:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776550.520324:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462075264 00000100:00100000:1.0:1789776550.520333:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462075264 00010000:00010000:1.0:1789776550.520367:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef8a0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c286d expref: 23 pid: 5812 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776550.520397:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 60 00000100:00100000:1.0:1789776550.520404:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c869880b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0795fb8a-e14a-4768-806c-f332ad101de7+23:2356:x1876716462075264:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776550.520416:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776550.520420:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef8a0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c286d expref: 23 pid: 5812 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.520445:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef8a0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c286d expref: 23 pid: 5812 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.520463:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef8a0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c286d expref: 23 pid: 5812 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.520476:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c8683789400) 00010000:00010000:1.0:1789776550.520481:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775400/0x26940258de8ef995 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.520487:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775400/0x26940258de8ef995 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.520492:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775400/0x26940258de8ef995 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776550.520513:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789776550.520628:0:5813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775400/0x26940258de8ef995 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.520639:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775400/0x26940258de8ef995 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776550.520677:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789776550.520681:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789776550.520701:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775400/0x26940258de8ef995 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.520713:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775400/0x26940258de8ef995 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.520720:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775e00/0x26940258de8ef987 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.520724:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775e00/0x26940258de8ef987 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.520729:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775e00/0x26940258de8ef987 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.520732:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8686775e00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776550.520735:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775e00/0x26940258de8ef987 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.520749:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775e00/0x26940258de8ef987 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.520755:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c8682cbe900) 00010000:00010000:2.0:1789776550.520756:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776550.520759:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775e00/0x26940258de8ef987 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.520900:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775e00/0x26940258de8ef987 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.520912:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775600/0x26940258de8ef98e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.520918:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775600/0x26940258de8ef98e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.520924:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775600/0x26940258de8ef98e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.520928:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8686775600 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776550.520931:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775600/0x26940258de8ef98e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.520936:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775600/0x26940258de8ef98e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.520944:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c86881a7300) 00010000:00010000:2.0:1789776550.520947:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776550.520950:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775600/0x26940258de8ef98e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.520955:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775600/0x26940258de8ef98e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.520986:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774000/0x26940258de8ef980 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28ac expref: 23 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.520998:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775400/0x26940258de8ef995 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28ac expref: 22 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776550.521013:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c8683789400) 00010000:00010000:2.0:1789776550.521016:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789776550.521018:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8686775400, rc 0) 00000100:00100000:2.0:1789776550.521045:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf29b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+22:10537:x1876716462074880:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 11302us (11496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776550.521052:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 129 00000100:00100000:1.0:1789776550.521098:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c869880b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0795fb8a-e14a-4768-806c-f332ad101de7+22:2356:x1876716462075264:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 154us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776550.521108:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 60 00010000:00010000:0.0:1789776550.805420:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776551.316744:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9db43398-240e-4f78-8778-c11d527e09a1:3273:1876716471521920:0@lo:400:kworker.0 00000100:00100000:2.0:1789776551.316831:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776551.316978:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471521920 00000100:00100000:1.0:1789776551.316986:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471521920 00000100:00100000:1.0:1789776551.317047:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1789776551.317056:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa594450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+19:3273:x1876716471521920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776551.319458:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa594450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+19:3273:x1876716471521920:12345-0@lo:400:kworker.0 Request processed in 2397us (2621us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776551.319473:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1789776551.319633:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9db43398-240e-4f78-8778-c11d527e09a1:3273:1876716471521920:0@lo:400:kworker.0 00000100:00100000:2.0:1789776551.319653:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789776551.319662:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3273:1876716471522048:0@lo:400:kworker.0 00000100:00100000:2.0:1789776551.319712:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776551.319881:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471522048 00000100:00100000:3.0:1789776551.319894:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471522048 00000100:00100000:3.0:1789776551.319953:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789776551.319963:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba3bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1876716471522048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776551.320096:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba3bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1876716471522048:12345-0@lo:400:kworker.0 Request processed in 135us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776551.320103:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789776551.320383:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789776551.320571:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3273:1876716471522048:0@lo:400:kworker.0 00000100:00100000:3.0:1789776551.320620:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471522304:0@lo:400:kworker.0 00000100:00100000:3.0:1789776551.320661:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776551.320694:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3276:1876716471522176:0@lo:400:kworker.0 00000100:00100000:3.0:1789776551.320717:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776551.320785:0:8384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471522304 00000100:00100000:2.0:1789776551.320789:0:8384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471522304 00000100:00100000:2.0:1789776551.320824:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789776551.320831:0:8384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3276:x1876716471522304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776551.320869:0:8384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3276:x1876716471522304:12345-0@lo:400:kworker.0 Request processed in 38us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776551.320876:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789776551.321003:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471522304:0@lo:400:kworker.0 00000100:00100000:0.0:1789776551.321138:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba376680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471522560:0@lo:400:kworker.0 00000100:00100000:0.0:1789776551.321169:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776551.321189:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789776551.321548:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba375c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3274:1876716471522432:0@lo:400:kworker.0 00000100:00100000:0.0:1789776551.321577:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776551.321682:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471522560 00000100:00100000:0.0:1789776551.321687:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471522560 00000100:00100000:0.0:1789776551.321737:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789776551.321745:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba374380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471522560:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789776551.321855:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789776551.321931:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba374380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471522560:12345-0@lo:400:kworker.0 Request processed in 185us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776551.321948:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789776551.322017:0:3274:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1789776551.322024:0:3274:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:3.0:1789776551.322043:0:3274:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c86ba3bf480, transno 4294967301 00000004:00080000:3.0:1789776551.322059:0:3274:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:3.0:1789776551.322071:0:3274:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c86bf7bc700, transno 4294967304 00000100:00100000:3.0:1789776551.322077:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba376680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471522560:0@lo:400:kworker.0 00000100:00100000:1.0:1789776551.322755:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471522176 00000100:00100000:1.0:1789776551.322772:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471522176 00000100:00100000:1.0:1789776551.322864:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471522432 00000100:00100000:1.0:1789776551.322867:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471522432 00000100:00100000:0.0:1789776551.322906:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789776551.322916:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876716471522176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776551.322971:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876716471522176:12345-0@lo:400:kworker.0 Request processed in 58us (2253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776551.322978:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:3.0:1789776551.323093:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789776551.323124:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3276:1876716471522176:0@lo:400:kworker.0 00000100:00100000:1.0:1789776551.323547:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789776551.323556:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1876716471522432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776551.323610:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1876716471522432:12345-0@lo:400:kworker.0 Request processed in 56us (2031us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776551.323616:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789776551.323680:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba375c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3274:1876716471522432:0@lo:400:kworker.0 00000040:00080000:2.0:1789776551.449427:0:11658:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789776551.449435:0:11658:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789776551.449490:0:11658:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789776551.449498:0:11658:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789776551.449623:0:11658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bf480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11658:1876716471522688:192.168.202.6@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789776551.449719:0:11658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8687ef79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789776551.457205:0:11658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bf480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11658:1876716471522688:192.168.202.6@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789776551.460182:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776551.460312:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462075392 00000100:00100000:2.0:1789776551.460322:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462075392 00000100:00100000:2.0:1789776551.460401:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 130 00000100:00100000:2.0:1789776551.460412:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba377100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+21:10548:x1876716462075392:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789776551.460450:0:8177:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789776551.460560:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba377100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+21:10548:x1876716462075392:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 Request processed in 149us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776551.460568:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 130 00000100:00080000:3.0:1789776551.460781:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789776551.469501:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776551.469585:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462075648 00000100:00100000:1.0:1789776551.469596:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462075648 00000100:00100000:1.0:1789776551.469661:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 131 00000100:00100000:1.0:1789776551.469672:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+21:10548:x1876716462075648:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789776551.469695:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776551.469717:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8ef99c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c28b3 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776551.469826:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef9a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776551.469842:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef9a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776551.469857:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef9a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776551.469868:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789776551.470002:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8ef99c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28b3 expref: 24 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776551.470037:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef9a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28b3 expref: 23 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776551.470047:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c8683789400) 00010000:00010000:1.0:1789776551.470050:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789776551.470054:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86bf5cb400, rc 0) 00000100:00100000:1.0:1789776551.470133:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+23:10548:x1876716462075648:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 462us (641us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1789776551.470141:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 131 00000100:00100000:2.0:1789776551.486924:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776551.487106:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462075904 00000100:00100000:0.0:1789776551.487116:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462075904 00000100:00100000:0.0:1789776551.487296:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 132 00000100:00100000:0.0:1789776551.487307:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba3bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+23:10548:x1876716462075904:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789776551.487397:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef9b1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776551.487418:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef9b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776551.487430:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef9b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776551.487678:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef9b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776551.487686:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef9b1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776551.487693:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef9b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776551.487707:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b08e00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776551.487711:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef9b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776551.487719:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef9b1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776551.487734:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c8683789400) 00010000:00010000:0.0:1789776551.487737:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789776551.487743:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef9b1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776551.487835:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef9b1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776551.487989:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba3bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+24:10548:x1876716462075904:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 682us (1071us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1789776551.487997:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 132 00000040:00080000:2.0:1789776551.489452:0:11658:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789776551.489459:0:11658:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789776551.490418:0:11658:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789776551.490440:0:11658:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789776551.493015:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776551.493125:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776551.493157:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462076288 00000100:00100000:0.0:1789776551.493168:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462076288 00000100:00100000:3.0:1789776551.493296:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462076032 00000100:00100000:3.0:1789776551.493301:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462076032 00000100:00100000:3.0:1789776551.493350:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 9 00000100:00100000:3.0:1789776551.493360:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba376d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0795fb8a-e14a-4768-806c-f332ad101de7+25:2354:x1876716462076032:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789776551.493384:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776551.493411:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8ef9a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28b3 expref: 25 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776551.493428:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c8683789400) 00010000:00010000:3.0:1789776551.493433:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776551.493483:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba376d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0795fb8a-e14a-4768-806c-f332ad101de7+24:2354:x1876716462076032:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 124us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776551.493490:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 9 00000100:00100000:0.0:1789776551.494550:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 34 00000100:00100000:0.0:1789776551.494560:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+23:10548:x1876716462076288:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789776551.495956:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+24:10548:x1876716462076288:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 Request processed in 1392us (2824us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1789776551.495968:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 34 00000040:00080000:1.0:1789776551.526939:0:12028:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789776551.526951:0:12028:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789776551.527004:0:12028:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789776551.527009:0:12028:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789776551.734460:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776551.734566:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462076544 00000100:00100000:1.0:1789776551.734577:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462076544 00000100:00100000:1.0:1789776551.734674:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 133 00000100:00100000:1.0:1789776551.734686:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86880cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+24:10561:x1876716462076544:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1789776551.734713:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776551.734744:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8ef9b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c28ba expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776551.734959:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cba00/0x26940258de8ef9bf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776551.734973:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cba00/0x26940258de8ef9bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776551.735003:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cba00/0x26940258de8ef9bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776551.735015:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789776551.735206:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8ef9b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28ba expref: 27 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776551.735255:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cba00/0x26940258de8ef9bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28ba expref: 26 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776551.735263:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c8683789400) 00010000:00010000:1.0:1789776551.735266:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789776551.735270:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86bf5cba00, rc 0) 00000100:00100000:1.0:1789776551.735346:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86880cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+26:10561:x1876716462076544:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 662us (895us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1789776551.735352:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 133 00000100:00100000:3.0:1789776551.738454:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776551.739592:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462076672 00000100:00100000:0.0:1789776551.739603:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462076672 00000100:00100000:0.0:1789776551.739673:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 134 00000100:00100000:0.0:1789776551.739682:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+26:10561:x1876716462076672:12345-192.168.202.6@tcp:54:lfs.0 00010000:00010000:0.0:1789776551.739769:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef9cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776551.739788:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef9cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776551.739798:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef9cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776551.739828:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef9cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776551.739835:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef9cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776551.739842:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef9cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776551.739848:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b08e00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776551.739853:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef9cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776551.739861:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef9cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776551.739874:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c8683789400) 00010000:00010000:0.0:1789776551.739877:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789776551.739896:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef9cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776551.739903:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8ef9cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776551.739982:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+26:10561:x1876716462076672:12345-192.168.202.6@tcp:54:lfs.0 Request processed in 300us (1538us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776551.739990:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 134 00000100:00100000:3.0:1789776551.829407:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789776551.829432:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471522816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789776551.829505:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776551.829637:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471522816 00000100:00100000:0.0:1789776551.829646:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471522816 00000100:00100000:0.0:1789776551.829702:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789776551.829712:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471522816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789776551.829754:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789776551.829810:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471522816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776551.829818:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00010000:0.0:1789776551.829937:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776551.830017:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471522816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789776551.849457:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776551.849821:0:8384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462076800 00000100:00100000:2.0:1789776551.849832:0:8384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462076800 00000100:00100000:2.0:1789776551.849911:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 46 00000100:00100000:2.0:1789776551.849921:0:8384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0795fb8a-e14a-4768-806c-f332ad101de7+6:2354:x1876716462076800:12345-192.168.202.6@tcp:101:cat.0 00010000:00010000:2.0:1789776551.849940:0:8384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776551.849961:0:8384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fc4cd84/0x26940258de8ef9d4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c28c1 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789776551.850013:0:8384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aadd2a6, atime: 0x6aadd2a5, ctime: 0x6aadd2a6, blocks: 0xb 00010000:00010000:2.0:1789776551.850035:0:8384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=304s v=(0 0) 00010000:00010000:2.0:1789776551.850040:0:8384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776551.850050:0:8384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fc4cd84/0x26940258de8ef9d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28c1 expref: 7 pid: 8384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776551.850071:0:8384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004fc4cd84/0x26940258de8ef9d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28c1 expref: 7 pid: 8384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776551.850103:0:8384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8686774400, rc 0) 00000100:00100000:2.0:1789776551.850183:0:8384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0795fb8a-e14a-4768-806c-f332ad101de7+7:2354:x1876716462076800:12345-192.168.202.6@tcp:101:cat.0 Request processed in 264us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776551.850191:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 46 00000100:00100000:0.0:1789776551.856962:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776551.857313:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462076928 00000100:00100000:2.0:1789776551.857325:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462076928 00002000:00100000:2.0:1789776551.857391:0:6665:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9c86880cc000 x1876716462076928/t0(0) o3->0795fb8a-e14a-4768-806c-f332ad101de7@192.168.202.6@tcp:742/0 lens 488/0 e 0 to 0 dl 1789776562 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789776551.857403:0:6665:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c86880cc000 with x1876716462076928 ext(0->4095) 00002000:00010000:2.0:1789776551.857408:0:6665:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c86880cc000 00000100:00100000:2.0:1789776551.857445:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 3 00000100:00100000:2.0:1789776551.857454:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86880cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0795fb8a-e14a-4768-806c-f332ad101de7+7:2357:x1876716462076928:12345-192.168.202.6@tcp:3:cat.0 00000100:00100000:2.0:1789776551.857691:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86880cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0795fb8a-e14a-4768-806c-f332ad101de7+7:2357:x1876716462076928:12345-192.168.202.6@tcp:3:cat.0 Request processed in 237us (739us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789776551.857717:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 3 00002000:00100000:2.0:1789776551.857737:0:6665:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9c86880cc000 x1876716462076928/t0(0) o3->0795fb8a-e14a-4768-806c-f332ad101de7@192.168.202.6@tcp:742/0 lens 488/4536 e 0 to 0 dl 1789776562 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789776551.857746:0:6665:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c86880cc000 with x1876716462076928 ext(0->4095) 00002000:00010000:2.0:1789776551.857750:0:6665:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c86880cc000 00010000:00010000:2.0:1789776552.853778:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776553.763387:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776553.763517:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776553.763559:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776553.763585:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776553.763646:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462077056 00000100:00100000:1.0:1789776553.763657:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462077056 00000100:00100000:1.0:1789776553.763711:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 287 00000100:00100000:1.0:1789776553.763735:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa596c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:2357:x1876716462077056:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1789776553.763827:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa596c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:2357:x1876716462077056:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 94us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776553.763835:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 287 00000100:00100000:2.0:1789776553.764040:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462077312 00000100:00100000:2.0:1789776553.764046:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462077312 00000100:00100000:2.0:1789776553.764104:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 78 00000100:00100000:2.0:1789776553.764112:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0795fb8a-e14a-4768-806c-f332ad101de7+7:2357:x1876716462077312:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1789776553.764155:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0795fb8a-e14a-4768-806c-f332ad101de7+7:2357:x1876716462077312:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 44us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776553.764163:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 78 00000100:00080000:2.0:1789776553.764275:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789776553.769053:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776553.769682:0:8384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462077440 00000100:00100000:1.0:1789776553.769693:0:8384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462077440 00000100:00100000:1.0:1789776553.769786:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 79 00000100:00100000:1.0:1789776553.769797:0:8384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb569880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0795fb8a-e14a-4768-806c-f332ad101de7+5:2356:x1876716462077440:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1789776553.769892:0:8384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb569880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0795fb8a-e14a-4768-806c-f332ad101de7+5:2356:x1876716462077440:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 96us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776553.769901:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 79 00000100:00080000:3.0:1789776553.770988:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789776553.771620:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462077184 00000100:00100000:0.0:1789776553.771631:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462077184 00000100:00100000:0.0:1789776553.771796:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462077568 00000100:00100000:0.0:1789776553.771800:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462077568 00000100:00100000:1.0:1789776553.771847:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 141 00000100:00100000:1.0:1789776553.771858:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+26:2356:x1876716462077184:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1789776553.771941:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+26:2356:x1876716462077184:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 86us (8565us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776553.771949:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 141 00000100:00080000:3.0:1789776553.772869:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789776553.774023:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 142 00000100:00100000:0.0:1789776553.774047:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d27fff26-e747-430b-8151-cc0e7e6df617+5:2357:x1876716462077568:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1789776553.774136:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d27fff26-e747-430b-8151-cc0e7e6df617+5:2357:x1876716462077568:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 103us (10549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776553.774144:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 142 00010000:00010000:2.0:1789776553.876504:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776554.902138:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776555.413029:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789776555.413082:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86880cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471522944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789776555.413200:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776555.413307:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471522944 00000100:00100000:0.0:1789776555.413317:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471522944 00000100:00100000:0.0:1789776555.413378:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789776555.413388:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86880cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3275:x1876716471522944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789776555.413431:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789776555.413486:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86880cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3275:x1876716471522944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776555.413494:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789776555.413548:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86880cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471522944:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789776555.415693:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789776555.501409:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000001:00080000:0.0:1789776555.501443:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1789776555.501465:0:5833:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c86ba8c9600 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1789776555.501472:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c8698635f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c8682de1000 00000020:00080000:0.0:1789776555.501476:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c8698635c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c86ba79c400 00000020:00080000:3.0:1789776555.501514:0:5844:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 1 00000020:00080000:3.0:1789776555.501796:0:5844:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1789776555.501944:0:5833:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:0.0:1789776555.507503:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:0.0:1789776555.507530:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:0.0:1789776555.507537:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00010000:00010000:0.0:1789776555.924521:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776556.437465:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789776556.437499:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86880cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9db43398-240e-4f78-8778-c11d527e09a1:3274:1876716471523072:0@lo:400:kworker.0 00000100:00100000:1.0:1789776556.437610:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776556.437691:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471523072 00000100:00100000:1.0:1789776556.437701:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471523072 00000100:00100000:1.0:1789776556.437767:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1789776556.437777:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa596450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+19:3274:x1876716471523072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776556.437841:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa596450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+19:3274:x1876716471523072:12345-0@lo:400:kworker.0 Request processed in 64us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776556.437849:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1789776556.437908:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86880cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9db43398-240e-4f78-8778-c11d527e09a1:3274:1876716471523072:0@lo:400:kworker.0 00000100:00100000:2.0:1789776556.440567:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba20f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3273:1876716471523584:0@lo:400:kworker.0 00000100:00100000:2.0:1789776556.440664:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776556.440722:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471523584 00000100:00100000:2.0:1789776556.440730:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789776556.440733:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471523584 00000100:00100000:2.0:1789776556.440736:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3273:1876716471523200:0@lo:400:kworker.0 00000100:00100000:2.0:1789776556.440764:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776556.440781:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba20ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471523712:0@lo:400:kworker.0 00000100:00100000:1.0:1789776556.440802:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471523200 00000100:00100000:1.0:1789776556.440805:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471523200 00000100:00100000:2.0:1789776556.440807:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776556.440832:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789776556.440839:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba20d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471523456:0@lo:400:kworker.0 00000100:00100000:1.0:1789776556.440843:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba3bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1876716471523584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776556.440865:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776556.440894:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789776556.440901:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba20ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3276:1876716471523328:0@lo:400:kworker.0 00000100:00100000:2.0:1789776556.440922:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776556.440927:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba3bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1876716471523584:12345-0@lo:400:kworker.0 Request processed in 86us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776556.440935:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:2.0:1789776556.440938:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789776556.440952:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471523712 00000100:00100000:1.0:1789776556.440952:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471523328 00000100:00100000:2.0:1789776556.440956:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471523712 00000100:00100000:1.0:1789776556.440956:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471523328 00000100:00100000:2.0:1789776556.440988:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471523456 00000100:00100000:2.0:1789776556.440991:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471523456 00000100:00100000:2.0:1789776556.441014:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789776556.441020:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471523712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776556.441068:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471523712:12345-0@lo:400:kworker.0 Request processed in 47us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776556.441069:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789776556.441075:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789776556.441076:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1876716471523200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776556.441089:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789776556.441095:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471523456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776556.441105:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1876716471523200:12345-0@lo:400:kworker.0 Request processed in 30us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776556.441111:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789776556.441123:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789776556.441125:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471523456:12345-0@lo:400:kworker.0 Request processed in 30us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776556.441129:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9de5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876716471523328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776556.441131:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789776556.441153:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9de5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876716471523328:12345-0@lo:400:kworker.0 Request processed in 25us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776556.441159:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:2.0:1789776556.441163:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789776556.441166:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789776556.441197:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba20ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3276:1876716471523328:0@lo:400:kworker.0 00000100:00100000:2.0:1789776556.441210:0:3276:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1789776556.441343:0:3276:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c86bf7bd500, transno 4294967310 00000004:00080000:2.0:1789776556.441366:0:3276:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1789776556.441396:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba20d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471523456:0@lo:400:kworker.0 00000100:00100000:2.0:1789776556.441426:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3273:1876716471523200:0@lo:400:kworker.0 00000100:00100000:2.0:1789776556.441435:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba20ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471523712:0@lo:400:kworker.0 00000100:00100000:2.0:1789776556.441656:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba20f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3273:1876716471523584:0@lo:400:kworker.0 00000100:00100000:0.0:1789776556.756800:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776556.761433:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462077696 00000100:00100000:3.0:1789776556.761456:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462077696 00000100:00100000:3.0:1789776556.763343:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 135 00000100:00100000:3.0:1789776556.763361:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+13:10222:x1876716462077696:12345-192.168.202.6@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789776556.763528:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+13:10222:x1876716462077696:12345-192.168.202.6@tcp:60:lhsmtool_posix.0 Request processed in 171us (6744us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776556.763538:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 135 00000100:00080000:0.0:1789776556.765275:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789776556.781264:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776556.784120:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462077952 00000100:00100000:3.0:1789776556.784144:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462077952 00000100:00100000:3.0:1789776556.786525:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 35 00000100:00100000:3.0:1789776556.786542:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb56b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+13:10222:x1876716462077952:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789776556.787032:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb56b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+14:10222:x1876716462077952:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 Request processed in 490us (5885us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1789776556.787053:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 35 00000100:00100000:3.0:1789776556.948532:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789776556.948565:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9de6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471523840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789776556.948669:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776556.948947:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471523840 00000100:00100000:0.0:1789776556.948958:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471523840 00000100:00100000:0.0:1789776556.949068:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789776556.949082:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb56aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471523840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789776556.949154:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789776556.949270:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb56aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471523840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 191us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776556.949278:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789776556.949593:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9de6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471523840:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789776556.949728:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776557.007001:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776557.007621:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462078080 00000100:00100000:1.0:1789776557.007637:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462078080 00000100:00100000:1.0:1789776557.007813:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 136 00000100:00100000:1.0:1789776557.007828:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d27fff26-e747-430b-8151-cc0e7e6df617+5:11013:x1876716462078080:12345-192.168.202.6@tcp:101:lsof.0 00010000:00010000:1.0:1789776557.007861:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776557.007894:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8ef9db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c28c8 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.007991:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef9e2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.008042:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef9e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.008057:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef9e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789776557.010276:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1789776557.010431:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789776557.010441:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789776557.010536:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef9e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.010590:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8ef9db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28c8 expref: 7 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.010617:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef9e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28c8 expref: 6 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776557.010627:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c86881a7800) 00010000:00010000:1.0:1789776557.010630:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789776557.010635:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86bf5cbc00, rc 0) 00000100:00100000:1.0:1789776557.010749:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d27fff26-e747-430b-8151-cc0e7e6df617+6:11013:x1876716462078080:12345-192.168.202.6@tcp:101:lsof.0 Request processed in 2923us (3762us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776557.010759:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 136 00000040:00080000:3.0:1789776557.652641:0:11658:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789776557.652658:0:11658:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789776557.652729:0:11658:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789776557.652748:0:11658:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789776557.972624:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776558.876696:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776558.876754:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776558.876793:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776558.876829:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462078464 00000100:00100000:3.0:1789776558.876833:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776558.876843:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462078464 00000100:00100000:3.0:1789776558.876910:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776558.876922:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462078592 00000100:00100000:2.0:1789776558.876924:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462078592 00000100:00100000:3.0:1789776558.876937:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462078720 00000100:00100000:2.0:1789776558.876957:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 82 00000100:00100000:3.0:1789776558.876959:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462078720 00000100:00100000:2.0:1789776558.876970:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb56b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+6:2356:x1876716462078464:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1789776558.876990:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462078336 00000100:00100000:3.0:1789776558.876992:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462078336 00000100:00100000:3.0:1789776558.877012:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 146 00000100:00100000:3.0:1789776558.877051:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d27fff26-e747-430b-8151-cc0e7e6df617+6:2356:x1876716462078720:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1789776558.877142:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d27fff26-e747-430b-8151-cc0e7e6df617+6:2356:x1876716462078720:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 122us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776558.877150:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 146 00000100:00100000:3.0:1789776558.877169:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 147 00000100:00100000:3.0:1789776558.877175:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb56ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+14:2356:x1876716462078336:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1789776558.877177:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb56b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+6:2356:x1876716462078464:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 211us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776558.877184:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 82 00000100:00100000:2.0:1789776558.877199:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 83 00000100:00100000:3.0:1789776558.877202:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb56ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+14:2356:x1876716462078336:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 28us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776558.877205:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb568380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+5:2356:x1876716462078592:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1789776558.877209:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 147 00000100:00100000:2.0:1789776558.877270:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb568380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+5:2356:x1876716462078592:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 65us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776558.877276:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 83 00000100:00080000:2.0:1789776558.877306:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789776558.877312:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789776558.877315:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789776558.877405:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462078208 00000100:00100000:1.0:1789776558.877411:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462078208 00000100:00100000:1.0:1789776558.877450:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 289 00000100:00100000:1.0:1789776558.877457:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa596050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:2356:x1876716462078208:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1789776558.877497:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa596050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:2356:x1876716462078208:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 40us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776558.877512:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 289 00010000:00010000:2.0:1789776558.998316:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776560.022567:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789776560.074463:0:12229:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 20:09:19 (1789776559) 00000100:00100000:2.0:1789776560.532484:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789776560.532516:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471523968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789776560.532587:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776560.533086:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471523968 00000100:00100000:0.0:1789776560.533095:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471523968 00000100:00100000:0.0:1789776560.533157:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789776560.533167:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9de7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471523968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789776560.533201:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789776560.533269:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9de7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471523968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776560.533276:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:2.0:1789776560.533360:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789776560.533406:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471523968:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1789776560.571673:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1789776560.571688:0:5833:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1789776560.571733:0:5844:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1789776560.571757:0:5844:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1789776561.052970:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776561.441265:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776561.441340:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462078976 00000100:00100000:0.0:1789776561.441350:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462078976 00000100:00100000:0.0:1789776561.441439:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 137 00000100:00100000:0.0:1789776561.441464:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+13:11278:x1876716462078976:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789776561.441485:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776561.441506:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08c00/0x26940258de8ef9e9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c28cf expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.441586:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8ef9f0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.441617:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8ef9f0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.441631:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8ef9f0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.441647:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef9f7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.441654:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef9f7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.441661:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef9f7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.441890:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08200/0x26940258de8ef9fe lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.441899:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08200/0x26940258de8ef9fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.441906:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08200/0x26940258de8ef9fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776561.441915:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1789776561.442073:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8ef9f0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.442081:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8ef9f0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.442088:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8ef9f0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.442101:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b08a00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776561.442105:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8ef9f0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.442111:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8ef9f0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.442123:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c86a08df500) 00010000:00010000:0.0:1789776561.442127:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776561.442131:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8ef9f0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.442136:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8ef9f0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.442148:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef9f7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.442154:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef9f7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.442172:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef9f7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789776561.442405:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789776561.442486:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b09000 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776561.442489:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef9f7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.442495:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef9f7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.442512:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9c86a08df900) 00010000:00010000:0.0:1789776561.442514:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776561.442517:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef9f7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.442523:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8ef9f7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.442983:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08c00/0x26940258de8ef9e9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28cf expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.443009:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08200/0x26940258de8ef9fe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28cf expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.443017:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c8683789100) 00010000:00010000:0.0:1789776561.443020:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776561.443022:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86b9b08200, rc 0) 00000100:00100000:0.0:1789776561.443395:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+15:11278:x1876716462078976:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 1945us (2137us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1789776561.443403:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 137 00000100:00100000:3.0:1789776561.470375:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776561.470472:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776561.470538:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462079232 00000100:00100000:1.0:1789776561.470549:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462079232 00000100:00100000:0.0:1789776561.470569:0:11143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462079104 00000100:00100000:0.0:1789776561.470573:0:11143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462079104 00000100:00100000:1.0:1789776561.470618:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 138 00000100:00100000:0.0:1789776561.470618:0:11143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00100000:1.0:1789776561.470628:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+16:11278:x1876716462079232:12345-192.168.202.6@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789776561.470628:0:11143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb56a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0795fb8a-e14a-4768-806c-f332ad101de7+16:2357:x1876716462079104:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789776561.470644:0:11143:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776561.470677:0:11143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08200/0x26940258de8ef9fe lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28cf expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776561.470718:0:11143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c8683789100) 00010000:00010000:0.0:1789776561.470725:0:11143:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776561.470732:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+15:11278:x1876716462079232:12345-192.168.202.6@tcp:59:lhsmtool_posix.0 Request processed in 106us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776561.470740:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 138 00000100:00100000:0.0:1789776561.470742:0:11143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb56a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0795fb8a-e14a-4768-806c-f332ad101de7+15:2357:x1876716462079104:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 117us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776561.470747:0:11143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00100000:0.0:1789776561.556393:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3274:1876716471524224:0@lo:400:kworker.0 00000100:00100000:0.0:1789776561.556459:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776561.556512:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471524736:0@lo:400:kworker.0 00000100:00100000:0.0:1789776561.556538:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776561.556569:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789776561.556574:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9db43398-240e-4f78-8778-c11d527e09a1:3274:1876716471524096:0@lo:400:kworker.0 00000100:00100000:0.0:1789776561.556601:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776561.556623:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3274:1876716471524608:0@lo:400:kworker.0 00000100:00100000:0.0:1789776561.556643:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776561.556681:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471524480:0@lo:400:kworker.0 00000100:00100000:0.0:1789776561.556703:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776561.556720:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789776561.556725:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3276:1876716471524352:0@lo:400:kworker.0 00000100:00100000:0.0:1789776561.556743:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776561.556781:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471524736 00000100:00100000:0.0:1789776561.556788:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471524736 00000100:00100000:0.0:1789776561.556839:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471524480 00000100:00100000:0.0:1789776561.556842:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471524480 00000100:00100000:0.0:1789776561.556862:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789776561.556869:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471524736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776561.556919:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471524736:12345-0@lo:400:kworker.0 Request processed in 50us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776561.556927:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789776561.556941:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789776561.556946:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471524480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776561.556971:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471524480:12345-0@lo:400:kworker.0 Request processed in 25us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776561.556977:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789776561.556993:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471524096 00000100:00100000:0.0:1789776561.557007:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471524096 00000100:00100000:0.0:1789776561.557032:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1789776561.557037:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa595c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+19:3274:x1876716471524096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776561.557066:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa595c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+19:3274:x1876716471524096:12345-0@lo:400:kworker.0 Request processed in 28us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776561.557072:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1789776561.557098:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471524224 00000100:00100000:0.0:1789776561.557102:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471524224 00000100:00100000:0.0:1789776561.557121:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471524608 00000100:00100000:0.0:1789776561.557123:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471524608 00000100:00100000:0.0:1789776561.557136:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471524352 00000100:00100000:0.0:1789776561.557139:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471524352 00000100:00100000:0.0:1789776561.557152:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789776561.557158:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1876716471524224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776561.557186:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1876716471524224:12345-0@lo:400:kworker.0 Request processed in 27us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776561.557191:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789776561.557202:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789776561.557234:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1876716471524608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776561.557266:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1876716471524608:12345-0@lo:400:kworker.0 Request processed in 52us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776561.557271:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789776561.557283:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789776561.557289:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876716471524352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776561.557319:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876716471524352:12345-0@lo:400:kworker.0 Request processed in 30us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776561.557324:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789776561.557367:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9db43398-240e-4f78-8778-c11d527e09a1:3274:1876716471524096:0@lo:400:kworker.0 00000100:00100000:0.0:1789776561.557379:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3274:1876716471524608:0@lo:400:kworker.0 00000100:00080000:3.0:1789776561.557380:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789776561.557385:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789776561.557388:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3274:1876716471524224:0@lo:400:kworker.0 00000100:00100000:0.0:1789776561.557396:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471524736:0@lo:400:kworker.0 00000100:00100000:3.0:1789776561.557417:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3276:1876716471524352:0@lo:400:kworker.0 00000100:00100000:3.0:1789776561.557427:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471524480:0@lo:400:kworker.0 00000040:00080000:2.0:1789776561.748535:0:11658:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789776561.748548:0:11658:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789776561.748589:0:11658:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789776561.748598:0:11658:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789776562.069162:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776562.070098:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789776562.070131:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9de4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471524864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789776562.070300:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776562.070596:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471524864 00000100:00100000:1.0:1789776562.070617:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471524864 00000100:00100000:1.0:1789776562.070695:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789776562.070708:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471524864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789776562.070764:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789776562.070842:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471524864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776562.070850:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789776562.071034:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9de4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471524864:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789776563.101406:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776563.611891:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776563.612020:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462079360 00000100:00100000:0.0:1789776563.612030:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462079360 00000100:00100000:0.0:1789776563.612102:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 139 00000100:00100000:0.0:1789776563.612113:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb56bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+14:11320:x1876716462079360:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1789776563.612139:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776563.612173:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8efa0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c28d6 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776563.612287:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8efa13 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776563.612304:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8efa13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776563.612318:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8efa13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776563.612336:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08c00/0x26940258de8efa1a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776563.612343:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08c00/0x26940258de8efa1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776563.612351:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08c00/0x26940258de8efa1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776563.612627:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8efa13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776563.612649:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8efa13 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776563.612657:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8efa13 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776563.612663:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b08a00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776563.612668:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8efa13 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776563.612687:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8efa13 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776563.612703:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c86881a7800) 00010000:00010000:0.0:1789776563.612706:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776563.612713:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8efa13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776563.612720:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8efa13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776563.612867:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08c00/0x26940258de8efa1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776563.612875:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08c00/0x26940258de8efa1a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776563.612881:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08c00/0x26940258de8efa1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776563.612885:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b08c00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776563.612888:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08c00/0x26940258de8efa1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776563.612894:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08c00/0x26940258de8efa1a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776563.612902:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9c86a08df700) 00010000:00010000:0.0:1789776563.612905:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776563.612908:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08c00/0x26940258de8efa1a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776563.612925:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08c00/0x26940258de8efa1a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776563.612960:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8efa0c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28d6 expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776563.612970:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c86881a7800) 00010000:00010000:0.0:1789776563.612973:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776563.612976:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8efa0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28d6 expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776563.612998:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86b9b09000, rc 0) 00000100:00100000:0.0:1789776563.613072:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb56bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+14:11320:x1876716462079360:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 961us (1193us total) trans 0 rc 301/301 00000100:00100000:0.0:1789776563.613080:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 139 00000100:00080000:3.0:1789776563.613894:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789776563.640532:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776563.640567:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462079616 00000100:00100000:3.0:1789776563.640576:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462079616 00000100:00100000:3.0:1789776563.640627:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 140 00000100:00100000:3.0:1789776563.640637:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+14:11320:x1876716462079616:12345-192.168.202.6@tcp:36:lfs.0 00010000:00010000:3.0:1789776563.640692:0:8177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776563.640719:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8ef38a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c270f expref: 14 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.640737:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c86881a7800) 00010000:00010000:3.0:1789776563.640743:0:8177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789776563.640960:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8efa21 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.640975:0:8177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef9e2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28c8 expref: 5 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.640998:0:8177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8efa21 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.641031:0:8177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef9e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28c8 expref: 5 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.641046:0:8177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef9e2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28c8 expref: 5 pid: 5813 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776563.641060:0:8177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb568e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8177:1876716471524992:192.168.202.6@tcp:104: 00000100:00100000:3.0:1789776563.641161:0:8177:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf128b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789776563.647305:0:8177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb568e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8177:1876716471524992:192.168.202.6@tcp:104: 00010000:00010000:1.0:1789776563.647335:0:8177:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8efa21 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776563.653131:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776563.653251:0:11144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462079744 00000100:00100000:1.0:1789776563.653261:0:11144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462079744 00010000:00010000:1.0:1789776563.653313:0:11144:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef9e2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28c8 expref: 6 pid: 5813 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776563.653367:0:11144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 61 00000100:00100000:1.0:1789776563.653377:0:11144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb569180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d27fff26-e747-430b-8151-cc0e7e6df617+6:2357:x1876716462079744:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776563.653392:0:11144:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776563.653400:0:11144:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef9e2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28c8 expref: 6 pid: 5813 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776563.653413:0:11144:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef9e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28c8 expref: 6 pid: 5813 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776563.653435:0:11144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8ef9e2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28c8 expref: 6 pid: 5813 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776563.653451:0:11144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c86881a7800) 00010000:00010000:1.0:1789776563.653458:0:11144:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8efa21 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776563.653467:0:11144:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8efa21 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776563.653474:0:11144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8efa21 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776563.653499:0:11144:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776563.653548:0:11144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb569180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d27fff26-e747-430b-8151-cc0e7e6df617+5:2357:x1876716462079744:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 173us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776563.653556:0:11144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 61 00010000:00010000:1.0:1789776563.653654:0:8177:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8efa21 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776563.653670:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8efa21 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776563.653693:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efa28 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776563.653703:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efa28 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776563.653710:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efa28 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776563.655024:0:8177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789776563.655039:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8efa21 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776563.655047:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8efa21 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776563.655054:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8efa21 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776563.655060:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681678800 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776563.655064:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8efa21 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776563.655075:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8efa21 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776563.655089:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c86881a7800) 00010000:00010000:1.0:1789776563.655092:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776563.655103:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8efa21 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776563.655110:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8efa21 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789776563.655129:0:8177:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000069d0e1c9 reply state 000000009d304bfd transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efa28 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776563.655138:0:8177:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789776563.655243:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+15:11320:x1876716462079616:12345-192.168.202.6@tcp:36:lfs.0 Request processed in 14580us (14694us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1789776563.655252:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 140 00000100:00080000:3.0:1789776563.655587:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789776563.677113:0:3259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efa28 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776563.677131:0:3259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efa28 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776563.677141:0:3259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efa28 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776563.677149:0:3259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5ca600 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776563.677155:0:3259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efa28 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776563.677164:0:3259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efa28 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776563.677190:0:3259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9c8683789600) 00010000:00010000:0.0:1789776563.677195:0:3259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776563.677201:0:3259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efa28 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776563.677208:0:3259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efa28 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776563.740673:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776563.740752:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462079872 00000100:00100000:0.0:1789776563.740764:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462079872 00000100:00100000:0.0:1789776563.740885:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 141 00000100:00100000:0.0:1789776563.740898:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba20e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+14:11328:x1876716462079872:12345-192.168.202.6@tcp:101:lctl.0 00010000:00010000:0.0:1789776563.740925:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776563.740949:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8efa2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c28dd expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776563.741029:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08c00/0x26940258de8efa36 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776563.741044:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08c00/0x26940258de8efa36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776563.741057:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08c00/0x26940258de8efa36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776563.741105:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789776563.741109:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789776563.741132:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08c00/0x26940258de8efa36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776563.741171:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8efa2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28dd expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776563.741191:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08c00/0x26940258de8efa36 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28dd expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776563.741200:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c86a08df700) 00010000:00010000:0.0:1789776563.741203:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789776563.741206:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86b9b08c00, rc 0) 00000100:00100000:0.0:1789776563.741300:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba20e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+15:11328:x1876716462079872:12345-192.168.202.6@tcp:101:lctl.0 Request processed in 406us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776563.741307:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 141 00000100:00100000:1.0:1789776563.782095:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776563.782504:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462080000 00000100:00100000:3.0:1789776563.782516:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462080000 00000100:00100000:3.0:1789776563.782580:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 142 00000100:00100000:3.0:1789776563.782591:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba20d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+15:11334:x1876716462080000:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:3.0:1789776563.782611:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776563.782647:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efa3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c28e4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.782727:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8efa44 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.782742:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8efa44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.782754:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8efa44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.782768:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efa4b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.782775:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efa4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.782782:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efa4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.782879:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8efa52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.782887:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8efa52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.782908:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8efa52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776563.782935:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1789776563.782938:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789776563.782954:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8efa52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.782966:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8efa44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.782972:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8efa44 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.782989:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8efa44 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.782995:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681678800 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776563.782999:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8efa44 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.783005:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8efa44 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.783017:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c86a08df700) 00010000:00010000:3.0:1789776563.783020:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776563.783025:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8efa44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.783032:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8efa44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.783057:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efa4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.783063:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efa4b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.783068:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efa4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.783073:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681678000 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776563.783076:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efa4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.783082:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efa4b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.783090:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9c8682cbef00) 00010000:00010000:3.0:1789776563.783093:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776563.783096:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efa4b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.783102:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efa4b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.783132:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efa3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28e4 expref: 17 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.783145:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8efa52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28e4 expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.783162:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:3.0:1789776563.783165:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789776563.783167:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8681679000, rc 0) 00000100:00100000:3.0:1789776563.783250:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba20d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+16:11334:x1876716462080000:12345-192.168.202.6@tcp:101:bash.0 Request processed in 659us (1166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776563.783258:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 142 00000100:00100000:2.0:1789776563.803810:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776563.803920:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462080256 00000100:00100000:3.0:1789776563.803933:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462080256 00000100:00100000:3.0:1789776563.804016:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 143 00000100:00100000:3.0:1789776563.804030:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9de7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+16:11334:x1876716462080256:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:3.0:1789776563.804054:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776563.804078:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efa59 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c28eb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.804260:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efa60 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.804276:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efa60 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.804287:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efa60 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.804326:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8efa67 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.804334:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8efa67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.804351:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8efa67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789776563.806201:0:5813:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1789776563.806395:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efa6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.806410:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efa6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.806421:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efa6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.806453:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efa60 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.806459:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efa60 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.806466:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efa60 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.806472:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681678000 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776563.806477:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efa60 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.806485:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efa60 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.806497:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:3.0:1789776563.806500:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776563.806510:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efa60 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.806516:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efa60 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789776563.806530:0:5813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000061fef011 reply state 000000003557cbfd transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8efa67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776563.806538:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789776563.806570:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efa59 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28eb expref: 19 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.806583:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efa6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28eb expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776563.806591:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c8682cbe500) 00010000:00010000:3.0:1789776563.806593:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789776563.806596:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8681679c00, rc 0) 00000100:00100000:3.0:1789776563.806686:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9de7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+19:11334:x1876716462080256:12345-192.168.202.6@tcp:101:bash.0 Request processed in 2659us (2888us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1789776563.806696:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 143 00010000:00010000:2.0:1789776563.813897:0:3260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8efa67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776563.813919:0:3260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8efa67 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776563.813928:0:3260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8efa67 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776563.813935:0:3260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681678800 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776563.813941:0:3260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8efa67 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776563.813949:0:3260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8efa67 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776563.813966:0:3260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c8682cbef00) 00010000:00010000:2.0:1789776563.813969:0:3260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776563.813974:0:3260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8efa67 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776563.813990:0:3260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8efa67 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776563.819006:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776563.819960:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462080384 00000100:00100000:0.0:1789776563.819974:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462080384 00000100:00100000:0.0:1789776563.820070:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 47 00000100:00100000:0.0:1789776563.820080:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9de6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+5:2357:x1876716462080384:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:0.0:1789776563.820101:0:6661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776563.820128:0:6661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b644bfcb/0x26940258de8efa7c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c28f2 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789776563.820160:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789776563.820181:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=316s v=(0 0) 00010000:00010000:0.0:1789776563.820185:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789776563.820195:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b644bfcb/0x26940258de8efa7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28f2 expref: 6 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776563.820254:0:6661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b644bfcb/0x26940258de8efa7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28f2 expref: 6 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776563.820273:0:6661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86b9b09c00, rc 0) 00000100:00100000:0.0:1789776563.820342:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9de6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+6:2357:x1876716462080384:12345-192.168.202.6@tcp:101:bash.0 Request processed in 262us (1344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776563.820352:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 47 00000100:00080000:0.0:1789776563.820380:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789776563.829654:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776563.829787:0:8384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462080512 00000100:00100000:2.0:1789776563.829799:0:8384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462080512 00000100:00100000:2.0:1789776563.829878:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 48 00000100:00100000:2.0:1789776563.829891:0:8384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba20f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0795fb8a-e14a-4768-806c-f332ad101de7+6:11334:x1876716462080512:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:2.0:1789776563.829919:0:8384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776563.829945:0:8384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f097c2e3/0x26940258de8efa83 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c28f9 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776563.829991:0:8384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b644bfcb/0x26940258de8efa7c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28f2 expref: 7 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776563.830002:0:8384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776563.830006:0:8384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776563.830012:0:8384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f097c2e3/0x26940258de8efa83 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28f9 expref: 7 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776563.830049:0:8384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b644bfcb/0x26940258de8efa7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28f2 expref: 7 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776563.830064:0:8384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b644bfcb/0x26940258de8efa7c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28f2 expref: 7 pid: 6661 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776563.830078:0:8384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9de4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8384:1876716471525120:192.168.202.6@tcp:104: 00000100:00100000:2.0:1789776563.830183:0:8384:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86b531db40 going to sleep for 11 seconds 00000100:00100000:1.0:1789776563.837336:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776563.840514:0:8384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9de4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8384:1876716471525120:192.168.202.6@tcp:104: 00010000:00010000:2.0:1789776563.840558:0:8384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f097c2e3/0x26940258de8efa83 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28f9 expref: 7 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776563.840678:0:8384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8686774e00, rc 0) 00000100:00100000:2.0:1789776563.840913:0:8384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba20f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0795fb8a-e14a-4768-806c-f332ad101de7+7:11334:x1876716462080512:12345-192.168.202.6@tcp:101:bash.0 Request processed in 11025us (11271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776563.840923:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 48 00000100:00100000:1.0:1789776563.842437:0:11142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462080640 00000100:00100000:1.0:1789776563.842449:0:11142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462080640 00010000:00010000:1.0:1789776563.842490:0:11142:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b644bfcb/0x26940258de8efa7c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28f2 expref: 7 pid: 6661 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776563.842534:0:11142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 62 00000100:00100000:1.0:1789776563.842544:0:11142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba20ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0795fb8a-e14a-4768-806c-f332ad101de7+7:2356:x1876716462080640:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776563.842560:0:11142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776563.842584:0:11142:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b644bfcb/0x26940258de8efa7c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28f2 expref: 7 pid: 6661 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776563.842600:0:11142:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b644bfcb/0x26940258de8efa7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28f2 expref: 7 pid: 6661 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776563.842638:0:11142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b644bfcb/0x26940258de8efa7c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28f2 expref: 7 pid: 6661 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776563.842654:0:11142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776563.842658:0:11142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776563.842666:0:11142:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f097c2e3/0x26940258de8efa83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28f9 expref: 6 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776563.842677:0:11142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f097c2e3/0x26940258de8efa83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28f9 expref: 6 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776563.842716:0:11142:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f097c2e3/0x26940258de8efa83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28f9 expref: 6 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776563.842732:0:11142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba20df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11142:1876716471525248:192.168.202.6@tcp:105: 00000100:00100000:1.0:1789776563.842810:0:11142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf1c4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789776563.850072:0:11142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba20df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11142:1876716471525248:192.168.202.6@tcp:105: 00010000:00010000:1.0:1789776563.850109:0:11142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776563.850192:0:11142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba20ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0795fb8a-e14a-4768-806c-f332ad101de7+6:2356:x1876716462080640:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 7648us (12869us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776563.850213:0:11142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 62 00000100:00100000:2.0:1789776563.851110:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776563.851461:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462080896 00000100:00100000:1.0:1789776563.851471:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462080896 00000100:00100000:1.0:1789776563.851525:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 36 00000100:00100000:1.0:1789776563.851535:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9de4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+18:11334:x1876716462080896:12345-192.168.202.6@tcp:35:bash.0 00000100:00100000:1.0:1789776563.851878:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9de4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+19:11334:x1876716462080896:12345-192.168.202.6@tcp:35:bash.0 Request processed in 343us (771us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1789776563.851886:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 36 00000100:00100000:0.0:1789776563.965896:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776563.967047:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462081152 00000100:00100000:1.0:1789776563.967059:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462081152 00000100:00100000:1.0:1789776563.967394:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 144 00000100:00100000:1.0:1789776563.967407:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+19:11344:x1876716462081152:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1789776563.967433:0:8177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776563.967455:0:8177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efa8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2900 expref: -99 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776563.967549:0:8177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789776563.967685:0:8177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efa8a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2900 expref: 21 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776563.967700:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c86a08df700) 00010000:00010000:1.0:1789776563.967703:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789776563.967709:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efa8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2900 expref: 21 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776563.967724:0:8177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86bf5caa00, rc 0) 00000100:00100000:1.0:1789776563.967802:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+20:11344:x1876716462081152:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 398us (1919us total) trans 4294967419 rc 301/301 00000100:00100000:1.0:1789776563.967810:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 144 00000100:00100000:0.0:1789776563.980455:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776563.980815:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462081408 00000100:00100000:3.0:1789776563.980825:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462081408 00000100:00100000:3.0:1789776563.980898:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 37 00000100:00100000:3.0:1789776563.980909:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+20:11344:x1876716462081408:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:3.0:1789776563.981376:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+21:11344:x1876716462081408:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 467us (932us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1789776563.981384:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 37 00000100:00100000:2.0:1789776563.996996:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776563.997054:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776563.997171:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462081536 00000100:00100000:1.0:1789776563.997185:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462081536 00000100:00100000:1.0:1789776563.997292:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 291 00000100:00100000:1.0:1789776563.997323:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa595850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:2357:x1876716462081536:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1789776563.997431:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa595850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:2357:x1876716462081536:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 110us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776563.997439:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 291 00000100:00100000:0.0:1789776563.997609:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462081664 00000100:00100000:0.0:1789776563.997615:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462081664 00000100:00100000:0.0:1789776563.997689:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 86 00000100:00100000:0.0:1789776563.997698:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9de6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+6:2357:x1876716462081664:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1789776563.997734:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9de6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+6:2357:x1876716462081664:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 38us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776563.997740:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 86 00000100:00080000:1.0:1789776563.997884:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789776564.050042:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776564.050691:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462081792 00000100:00100000:2.0:1789776564.050707:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462081792 00000100:00100000:2.0:1789776564.050788:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 145 00000100:00100000:2.0:1789776564.050801:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+21:11350:x1876716462081792:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1789776564.050838:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776564.050864:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775600/0x26940258de8efa98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2907 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776564.050939:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774000/0x26940258de8efa9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776564.050954:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774000/0x26940258de8efa9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776564.050964:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774000/0x26940258de8efa9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776564.051045:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789776564.051050:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789776564.051071:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774000/0x26940258de8efa9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776564.051136:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775600/0x26940258de8efa98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2907 expref: 23 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776564.051158:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774000/0x26940258de8efa9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2907 expref: 22 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776564.051167:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:2.0:1789776564.051170:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789776564.051176:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8686774000, rc 0) 00000100:00100000:2.0:1789776564.051308:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+22:11350:x1876716462081792:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 509us (1282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776564.051317:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 145 00000100:00100000:0.0:1789776564.055995:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776564.056061:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462082048 00000100:00100000:0.0:1789776564.056077:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462082048 00000100:00100000:0.0:1789776564.056152:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 146 00000100:00100000:0.0:1789776564.056164:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+22:11350:x1876716462082048:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1789776564.056195:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776564.056278:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08800/0x26940258de8efaa6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c290e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.056439:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09200/0x26940258de8efaad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.056805:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09200/0x26940258de8efaad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.056819:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09200/0x26940258de8efaad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776564.056832:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789776564.057005:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08800/0x26940258de8efaa6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c290e expref: 25 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.057032:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09200/0x26940258de8efaad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c290e expref: 24 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.057042:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c8682cbe500) 00010000:00010000:0.0:1789776564.057045:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789776564.057050:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86b9b09200, rc 0) 00000100:00100000:0.0:1789776564.057145:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+24:11350:x1876716462082048:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 982us (1179us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1789776564.057154:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 146 00000100:00100000:2.0:1789776564.060540:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776564.060769:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776564.060879:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462082432 00000100:00100000:3.0:1789776564.060895:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462082432 00000100:00100000:3.0:1789776564.061013:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 147 00000100:00100000:3.0:1789776564.061027:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa657800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+24:11350:x1876716462082432:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1789776564.061060:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776564.061088:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efabb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2915 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776564.061213:0:11143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462082176 00010000:00010000:3.0:1789776564.061276:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efac2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776564.061294:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efac2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776564.061309:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efac2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776564.061324:0:11143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462082176 00000004:00200000:3.0:1789776564.061326:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00000100:00100000:0.0:1789776564.061407:0:11143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 11 00000100:00100000:0.0:1789776564.061417:0:11143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa657480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0795fb8a-e14a-4768-806c-f332ad101de7+26:2355:x1876716462082176:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789776564.061467:0:11143:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776564.061489:0:11143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09200/0x26940258de8efaad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c290e expref: 27 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.061509:0:11143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c8682cbe500) 00010000:00010000:0.0:1789776564.061515:0:11143:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789776564.061568:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efabb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2915 expref: 27 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776564.061587:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efac2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2915 expref: 26 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776564.061595:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c8682cbe500) 00010000:00010000:3.0:1789776564.061599:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789776564.061601:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8681678000, rc 0) 00000100:00100000:0.0:1789776564.061850:0:11143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa657480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0795fb8a-e14a-4768-806c-f332ad101de7+26:2355:x1876716462082176:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 433us (1324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776564.061859:0:11143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 11 00000100:00100000:3.0:1789776564.062826:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa657800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+25:11350:x1876716462082432:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 1793us (2046us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1789776564.062855:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 147 00000100:00100000:1.0:1789776564.068843:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776564.070204:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462082560 00000100:00100000:0.0:1789776564.070287:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462082560 00000100:00100000:0.0:1789776564.070369:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 49 00000100:00100000:0.0:1789776564.070381:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba20df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0795fb8a-e14a-4768-806c-f332ad101de7+6:2357:x1876716462082560:12345-192.168.202.6@tcp:1:lfs.0 00010000:00010000:0.0:1789776564.070963:0:6662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e4584c3/0x26940258de8efad0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.071006:0:6662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f097c2e3/0x26940258de8efa83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28f9 expref: 6 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.071016:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789776564.071021:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789776564.071027:0:6662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e4584c3/0x26940258de8efad0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.071082:0:6662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f097c2e3/0x26940258de8efa83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28f9 expref: 6 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.071124:0:6662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f097c2e3/0x26940258de8efa83 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28f9 expref: 6 pid: 8384 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776564.071142:0:6662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6662:1876716471525376:192.168.202.6@tcp:104: 00000100:00100000:0.0:1789776564.071422:0:6662:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86aa4a4840 going to sleep for 11 seconds 00000100:00100000:1.0:1789776564.077408:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776564.077950:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462082688 00000100:00100000:2.0:1789776564.077964:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462082688 00002000:00100000:2.0:1789776564.078054:0:6665:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9c86ba20f800 x1876716462082688/t0(0) o4->0795fb8a-e14a-4768-806c-f332ad101de7@192.168.202.6@tcp:0/0 lens 504/0 e 0 to 0 dl 1789776575 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789776564.078068:0:6665:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c86ba20f800 with x1876716462082688 ext(0->12) 00010000:00010000:2.0:1789776564.078081:0:6665:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f097c2e3/0x26940258de8efa83 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28f9 expref: 7 pid: 8384 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776564.078104:0:6665:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f097c2e3/0x26940258de8efa83 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28f9 expref: 7 pid: 8384 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789776564.078113:0:6665:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9c86ba20f800 00000100:00100000:2.0:1789776564.078179:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 2 00000100:00100000:2.0:1789776564.078191:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba20f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0795fb8a-e14a-4768-806c-f332ad101de7+7:2356:x1876716462082688:12345-192.168.202.6@tcp:4:lfs.0 00000100:00100000:2.0:1789776564.079388:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba20f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0795fb8a-e14a-4768-806c-f332ad101de7+9:2356:x1876716462082688:12345-192.168.202.6@tcp:4:lfs.0 Request processed in 1190us (1987us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789776564.079403:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 2 00002000:00100000:2.0:1789776564.079414:0:6665:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9c86ba20f800 x1876716462082688/t4294967305(0) o4->0795fb8a-e14a-4768-806c-f332ad101de7@192.168.202.6@tcp:0/0 lens 504/448 e 0 to 0 dl 1789776575 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789776564.079425:0:6665:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c86ba20f800 with x1876716462082688 ext(0->12) 00010000:00010000:2.0:1789776564.079437:0:6665:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f097c2e3/0x26940258de8efa83 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28f9 expref: 9 pid: 8384 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776564.079482:0:6665:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f097c2e3/0x26940258de8efa83 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28f9 expref: 9 pid: 8384 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789776564.079491:0:6665:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9c86ba20f800 00000100:00100000:0.0:1789776564.080180:0:6662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6662:1876716471525376:192.168.202.6@tcp:104: 00010000:00010000:0.0:1789776564.080292:0:6662:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008e4584c3/0x26940258de8efad0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776564.082137:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776564.082292:0:11144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462082816 00000100:00100000:1.0:1789776564.082306:0:11144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462082816 00010000:00010000:1.0:1789776564.082359:0:11144:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f097c2e3/0x26940258de8efa83 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28f9 expref: 9 pid: 8384 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776564.082410:0:11144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 63 00000100:00100000:1.0:1789776564.082425:0:11144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf294e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0795fb8a-e14a-4768-806c-f332ad101de7+9:2357:x1876716462082816:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776564.082447:0:11144:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789776564.082473:0:11144:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789776564.082476:0:11144:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789776564 00002000:00010000:1.0:1789776564.082478:0:11144:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789776564 00002000:00010000:1.0:1789776564.082480:0:11144:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789776564 00010000:00010000:1.0:1789776564.082488:0:11144:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f097c2e3/0x26940258de8efa83 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28f9 expref: 9 pid: 8384 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776564.082504:0:11144:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f097c2e3/0x26940258de8efa83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28f9 expref: 9 pid: 8384 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776564.082536:0:11144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f097c2e3/0x26940258de8efa83 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28f9 expref: 9 pid: 8384 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776564.082580:0:11144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789776564.082588:0:11144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789776564.082596:0:11144:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008e4584c3/0x26940258de8efad0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776564.082607:0:11144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e4584c3/0x26940258de8efad0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776564.082661:0:11144:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776564.082749:0:11144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf294e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0795fb8a-e14a-4768-806c-f332ad101de7+8:2357:x1876716462082816:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 326us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776564.082758:0:11144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 63 00010000:00010000:0.0:1789776564.084270:0:6662:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008e4584c3/0x26940258de8efad0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.084293:0:6662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e4584c3/0x26940258de8efad0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.084339:0:6662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e4584c3/0x26940258de8efad0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.084348:0:6662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e4584c3/0x26940258de8efad0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.084357:0:6662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e4584c3/0x26940258de8efad0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.084389:0:6662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b09200 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:0.0:1789776564.084395:0:6662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e4584c3/0x26940258de8efad0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.084406:0:6662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e4584c3/0x26940258de8efad0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.084430:0:6662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e4584c3/0x26940258de8efad0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.084438:0:6662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e4584c3/0x26940258de8efad0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776564.084682:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba20df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0795fb8a-e14a-4768-806c-f332ad101de7+7:2357:x1876716462082560:12345-192.168.202.6@tcp:1:lfs.0 Request processed in 14298us (15846us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776564.084694:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 49 00000100:00100000:2.0:1789776564.090463:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776564.090790:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462083072 00000100:00100000:3.0:1789776564.090806:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462083072 00000100:00100000:3.0:1789776564.090911:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 38 00000100:00100000:3.0:1789776564.090924:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a0685450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+25:11350:x1876716462083072:12345-192.168.202.6@tcp:35:lfs.0 00000004:00010000:3.0:1789776564.091051:0:5815:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efac2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2915 expref: 25 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789776564.091483:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1789776564.091534:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:3.0:1789776564.092363:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:3.0:1789776564.092438:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8efad7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776564.092460:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efa6e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28eb expref: 29 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776564.092472:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8efad7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776564.092523:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efa6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28eb expref: 29 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776564.092545:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efa6e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28eb expref: 29 pid: 5813 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776564.092563:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb56b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5815:1876716471525504:192.168.202.6@tcp:104: 00000100:00100000:3.0:1789776564.093617:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf1280c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789776564.098011:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776564.098612:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462083200 00000100:00100000:0.0:1789776564.098637:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462083200 00010000:00010000:0.0:1789776564.098707:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efa6e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28eb expref: 30 pid: 5813 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776564.098761:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 64 00000100:00100000:0.0:1789776564.098772:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8698808450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0795fb8a-e14a-4768-806c-f332ad101de7+30:2357:x1876716462083200:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789776564.098793:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776564.098800:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efa6e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28eb expref: 30 pid: 5813 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.098836:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efa6e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28eb expref: 30 pid: 5813 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.098867:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c8682cbe500) 00010000:00010000:0.0:1789776564.098874:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8efad7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.098885:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8efad7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.098893:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8efad7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.098919:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776564.099005:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8698808450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0795fb8a-e14a-4768-806c-f332ad101de7+30:2357:x1876716462083200:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 235us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776564.099015:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 64 00010000:00010000:3.0:1789776564.100838:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efa6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28eb expref: 29 pid: 5813 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776564.100872:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb56b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5815:1876716471525504:192.168.202.6@tcp:104: 00010000:00010000:3.0:1789776564.100907:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8efad7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776564.100919:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8efad7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776564.100926:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8efad7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789776564.101189:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1789776564.101567:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:3.0:1789776564.101899:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb56b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1876716471525632:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789776564.102001:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776564.102113:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf128e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789776564.102366:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471525632 00000100:00100000:1.0:1789776564.102376:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471525632 00000100:00100000:1.0:1789776564.102515:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789776564.102527:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5815:x1876716471525632:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789776564.102653:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5815:x1876716471525632:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 128us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776564.102662:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789776564.102890:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb56b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1876716471525632:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789776564.103614:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1789776564.103723:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb56b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1876716471525760:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789776564.103789:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776564.103822:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf1280c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776564.104153:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471525760 00000100:00100000:1.0:1789776564.104161:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471525760 00000100:00100000:1.0:1789776564.104254:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789776564.104267:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb56a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5815:x1876716471525760:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789776564.104504:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb56a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5815:x1876716471525760:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 240us (714us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789776564.104527:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789776564.105021:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb56b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1876716471525760:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789776564.105120:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:3.0:1789776564.105183:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8efad7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776564.105197:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8efad7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776564.105241:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8efad7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776564.105250:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681679200 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776564.105256:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8efad7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776564.105266:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8efad7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776564.105287:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c8682cbe500) 00010000:00010000:3.0:1789776564.105290:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789776564.105297:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8efad7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776564.105303:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8efad7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789776564.105561:0:5815:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789776564.106129:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1789776564.106146:0:5815:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 316885928745ns, next at 317885925575ns, rc = 0 00000001:00080000:3.0:1789776564.106155:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1789776564.106207:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c8682cbe500) 00010000:00010000:3.0:1789776564.106211:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789776564.106244:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efac2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2915 expref: 33 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776564.106392:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a0685450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+32:11350:x1876716462083072:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 15470us (15945us total) trans 4294967431 rc 0/0 00000100:00100000:3.0:1789776564.106416:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 38 00000020:00080000:3.0:1789776564.106424:0:5815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:0.0:1789776564.107451:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789776564.109914:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776564.110017:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462083328 00000100:00100000:1.0:1789776564.110032:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462083328 00000100:00100000:1.0:1789776564.110116:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 148 00000100:00100000:1.0:1789776564.110128:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+32:11350:x1876716462083328:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1789776564.110163:0:8177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776564.110198:0:8177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8efade lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c291c expref: -99 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776564.110309:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8efade lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c291c expref: 33 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776564.110326:0:8177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8efade lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c291c expref: 33 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776564.110346:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c8683789000) 00010000:00010000:1.0:1789776564.110349:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789776564.110352:0:8177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86bf5cb600, rc 0) 00000100:00100000:1.0:1789776564.110421:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+33:11350:x1876716462083328:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 295us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776564.110428:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 148 00000100:00100000:3.0:1789776564.116483:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776564.116582:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462083584 00000100:00100000:1.0:1789776564.116593:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462083584 00000100:00100000:1.0:1789776564.116658:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 39 00000100:00100000:1.0:1789776564.116668:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb56b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+33:11350:x1876716462083584:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:1.0:1789776564.116929:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb56b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+34:11350:x1876716462083584:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 262us (457us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1789776564.116953:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 39 00010000:00010000:2.0:1789776564.119123:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776564.207111:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776564.207257:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462083840 00000100:00100000:0.0:1789776564.207268:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462083840 00000100:00100000:0.0:1789776564.207335:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 149 00000100:00100000:0.0:1789776564.207346:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+34:11360:x1876716462083840:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1789776564.207372:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776564.207395:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09e00/0x26940258de8efae5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2923 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776564.207640:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1789776564.207779:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09e00/0x26940258de8efae5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2923 expref: 36 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.207795:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c86a08df700) 00010000:00010000:0.0:1789776564.207798:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789776564.207803:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09e00/0x26940258de8efae5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2923 expref: 36 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.207818:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86b9b09e00, rc 0) 00000100:00100000:0.0:1789776564.207878:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+35:11360:x1876716462083840:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 535us (782us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1789776564.207885:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 149 00000100:00100000:0.0:1789776564.210125:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776564.210405:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462083968 00000100:00100000:1.0:1789776564.210415:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462083968 00000100:00100000:1.0:1789776564.210491:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 150 00000100:00100000:1.0:1789776564.210501:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+35:11360:x1876716462083968:12345-192.168.202.6@tcp:34:lfs.0 00010000:00010000:1.0:1789776564.210590:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8efaf3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776564.210607:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8efaf3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776564.210619:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8efaf3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776564.210635:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efafa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776564.210642:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efafa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776564.210648:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efafa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776564.210744:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8efb01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776564.210752:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8efb01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776564.210759:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8efb01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789776564.210822:0:8177:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8efb01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776564.210836:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8efaf3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776564.210842:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8efaf3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776564.210850:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8efaf3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776564.210856:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5cae00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776564.210860:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8efaf3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776564.210867:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8efaf3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776564.210880:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:1.0:1789776564.210884:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776564.210888:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8efaf3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776564.210893:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8efaf3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776564.210906:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efafa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776564.210911:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efafa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776564.210924:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efafa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776564.210928:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5caa00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776564.210930:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efafa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776564.210936:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efafa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776564.210942:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c8683789a00) 00010000:00010000:1.0:1789776564.210945:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776564.210947:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efafa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776564.210952:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efafa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776564.210969:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8efb01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776564.210986:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8efb01 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776564.210991:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8efb01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776564.210995:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5ca400 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776564.210997:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8efb01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776564.211012:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8efb01 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776564.211021:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c8683789000) 00010000:00010000:1.0:1789776564.211023:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776564.211026:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8efb01 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776564.211032:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8efb01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776564.211113:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+35:11360:x1876716462083968:12345-192.168.202.6@tcp:34:lfs.0 Request processed in 613us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776564.211122:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 150 00000100:00100000:1.0:1789776564.225101:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776564.225894:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462084224 00000100:00100000:3.0:1789776564.225915:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462084224 00000100:00100000:3.0:1789776564.226022:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 40 00000100:00100000:3.0:1789776564.226038:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba20c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+35:11360:x1876716462084224:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:3.0:1789776564.227085:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba20c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+36:11360:x1876716462084224:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 1042us (1993us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1789776564.228619:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 40 00000100:00100000:2.0:1789776564.299395:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776564.300826:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462084480 00000100:00100000:0.0:1789776564.300840:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462084480 00000100:00100000:0.0:1789776564.300918:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 151 00000100:00100000:0.0:1789776564.300930:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf297b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+36:11363:x1876716462084480:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1789776564.300956:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776564.300987:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08000/0x26940258de8efb08 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c292a expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.301065:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8efb0f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.301081:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8efb0f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.301102:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8efb0f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.301145:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09e00/0x26940258de8efb16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.301153:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09e00/0x26940258de8efb16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.301161:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09e00/0x26940258de8efb16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.301296:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09200/0x26940258de8efb1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.301304:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09200/0x26940258de8efb1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.301311:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09200/0x26940258de8efb1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776564.301320:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789776564.301410:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8efb0f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.301417:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8efb0f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.301424:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8efb0f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.301430:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b08400 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776564.301434:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8efb0f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.301751:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8efb0f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.301767:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:0.0:1789776564.301771:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776564.301777:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8efb0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.301784:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8efb0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.301800:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09e00/0x26940258de8efb16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.301806:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09e00/0x26940258de8efb16 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.301812:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09e00/0x26940258de8efb16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.301818:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b09e00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776564.301821:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09e00/0x26940258de8efb16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.301827:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09e00/0x26940258de8efb16 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.301833:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c86a08df300) 00010000:00010000:0.0:1789776564.301836:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776564.301838:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09e00/0x26940258de8efb16 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.301854:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09e00/0x26940258de8efb16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.301901:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08000/0x26940258de8efb08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c292a expref: 39 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.301915:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09200/0x26940258de8efb1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c292a expref: 38 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.301922:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c8683789000) 00010000:00010000:0.0:1789776564.301924:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789776564.301926:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86b9b09200, rc 0) 00000100:00100000:0.0:1789776564.302009:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf297b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+38:11363:x1876716462084480:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 1081us (2791us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1789776564.302016:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 151 00000100:00100000:0.0:1789776564.316034:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776564.319682:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462084608 00000100:00100000:3.0:1789776564.319698:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462084608 00000100:00100000:3.0:1789776564.319850:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 152 00000100:00100000:3.0:1789776564.319863:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+38:11363:x1876716462084608:12345-192.168.202.6@tcp:54:lfs.0 00010000:00010000:3.0:1789776564.319947:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efb2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776564.319966:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efb2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776564.319989:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efb2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776564.320017:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efb2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776564.320024:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efb2b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776564.320049:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efb2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776564.320056:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681678000 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776564.320060:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efb2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776564.320068:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efb2b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776564.320089:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c8683789000) 00010000:00010000:3.0:1789776564.320093:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789776564.320097:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efb2b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776564.320102:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efb2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776564.320197:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+38:11363:x1876716462084608:12345-192.168.202.6@tcp:54:lfs.0 Request processed in 335us (4174us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776564.320205:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 152 00000100:00100000:1.0:1789776564.324454:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776564.326315:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462084864 00000100:00100000:0.0:1789776564.326338:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462084864 00000100:00100000:0.0:1789776564.326479:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 41 00000100:00100000:0.0:1789776564.326493:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba20ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+38:11363:x1876716462084864:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:0.0:1789776564.328401:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba20ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+39:11363:x1876716462084864:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 1896us (3948us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1789776564.328418:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 41 00000100:00100000:2.0:1789776564.801454:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776564.801754:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462085120 00000100:00100000:0.0:1789776564.801773:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462085120 00000100:00100000:0.0:1789776564.801845:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 153 00000100:00100000:0.0:1789776564.801871:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf294e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+39:11394:x1876716462085120:12345-192.168.202.6@tcp:101:cat.0 00010000:00010000:0.0:1789776564.801894:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776564.801914:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08000/0x26940258de8efb32 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2931 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.802027:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09e00/0x26940258de8efb39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.802042:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09e00/0x26940258de8efb39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.802054:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09e00/0x26940258de8efb39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776564.802065:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789776564.802190:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08000/0x26940258de8efb32 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2931 expref: 42 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.802210:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09e00/0x26940258de8efb39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2931 expref: 41 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.802611:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c8683789000) 00010000:00010000:0.0:1789776564.802615:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789776564.802702:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86b9b09e00, rc 0) 00000100:00100000:0.0:1789776564.802783:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf294e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+41:11394:x1876716462085120:12345-192.168.202.6@tcp:101:cat.0 Request processed in 914us (1338us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1789776564.802791:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 153 00000100:00100000:2.0:1789776564.814893:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776564.815338:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776564.815955:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462085504 00000100:00100000:1.0:1789776564.815968:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462085504 00000100:00100000:1.0:1789776564.816051:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 12 00000100:00100000:1.0:1789776564.816062:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0795fb8a-e14a-4768-806c-f332ad101de7+41:2354:x1876716462085504:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776564.816080:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776564.816107:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09e00/0x26940258de8efb39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2931 expref: 41 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776564.816126:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c8683789000) 00010000:00010000:1.0:1789776564.816131:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776564.816194:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0795fb8a-e14a-4768-806c-f332ad101de7+40:2354:x1876716462085504:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 135us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776564.816260:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 12 00000100:00100000:3.0:1789776564.819475:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462085376 00000100:00100000:3.0:1789776564.819492:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462085376 00000100:00100000:3.0:1789776564.819639:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 42 00000100:00100000:3.0:1789776564.819653:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+40:11394:x1876716462085376:12345-192.168.202.6@tcp:35:cat.0 00000100:00100000:3.0:1789776564.830568:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+41:11394:x1876716462085376:12345-192.168.202.6@tcp:35:cat.0 Request processed in 10907us (15675us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1789776564.830592:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 42 00000100:00100000:1.0:1789776564.953159:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776564.953438:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462085760 00000100:00100000:2.0:1789776564.953448:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462085760 00000100:00100000:2.0:1789776564.953527:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 154 00000100:00100000:2.0:1789776564.953537:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba20c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+41:11400:x1876716462085760:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:2.0:1789776564.953561:0:8177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776564.953565:0:8177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789776564.953603:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774000/0x26940258de8efa9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2907 expref: 41 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776564.953624:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:2.0:1789776564.953635:0:8177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789776564.953768:0:8177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8efb47 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2938 expref: -99 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776564.953879:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efb4e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776564.953894:0:8177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09200/0x26940258de8efb1d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c292a expref: 41 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776564.953902:0:8177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efb4e lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776564.953939:0:8177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09200/0x26940258de8efb1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c292a expref: 41 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776564.953952:0:8177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09200/0x26940258de8efb1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c292a expref: 41 pid: 5811 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776564.953965:0:8177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6cad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8177:1876716471525888:192.168.202.6@tcp:104: 00000100:00100000:2.0:1789776564.954936:0:8177:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86b531db40 going to sleep for 11 seconds 00000100:00100000:2.0:1789776564.958881:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776564.958991:0:11144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462085888 00000100:00100000:0.0:1789776564.959000:0:11144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462085888 00010000:00010000:0.0:1789776564.959052:0:11144:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09200/0x26940258de8efb1d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c292a expref: 42 pid: 5811 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776564.959134:0:11144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 65 00000100:00100000:0.0:1789776564.959143:0:11144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0795fb8a-e14a-4768-806c-f332ad101de7+42:2357:x1876716462085888:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789776564.959159:0:11144:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776564.959166:0:11144:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09200/0x26940258de8efb1d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c292a expref: 42 pid: 5811 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.959180:0:11144:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09200/0x26940258de8efb1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c292a expref: 42 pid: 5811 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.959203:0:11144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c8683789000) 00010000:00010000:0.0:1789776564.959209:0:11144:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efb4e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.959258:0:11144:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efb4e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.959267:0:11144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efb4e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.959297:0:11144:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776564.959359:0:11144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0795fb8a-e14a-4768-806c-f332ad101de7+42:2357:x1876716462085888:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 217us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776564.959367:0:11144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 65 00010000:00010000:3.0:1789776564.960640:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09200/0x26940258de8efb1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c292a expref: 41 pid: 5811 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776564.960666:0:8177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6cad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8177:1876716471525888:192.168.202.6@tcp:104: 00010000:00010000:3.0:1789776564.960704:0:8177:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efb4e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776564.960953:0:8177:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efb4e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776564.960961:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efb4e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776564.960992:0:8177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789776564.961155:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8efb47 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2938 expref: 42 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776564.961170:0:8177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efb4e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2938 expref: 41 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776564.961178:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c8683789000) 00010000:00010000:2.0:1789776564.961181:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789776564.961184:0:8177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8686775c00, rc 0) 00000100:00100000:2.0:1789776564.961270:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba20c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+41:11400:x1876716462085760:12345-192.168.202.6@tcp:101:dd.0 Request processed in 7735us (8123us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1789776564.961278:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 154 00000100:00100000:2.0:1789776564.965629:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776564.965933:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462086144 00000100:00100000:3.0:1789776564.965943:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462086144 00000100:00100000:3.0:1789776564.966017:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 155 00000100:00100000:3.0:1789776564.966027:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+41:11400:x1876716462086144:12345-192.168.202.6@tcp:36:dd.0 00010000:00010000:3.0:1789776564.966353:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efb5c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776564.966370:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efb5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776564.966380:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efb5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789776564.966431:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:3.0:1789776564.966469:0:5813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000018dff38a reply state 00000000a46ec0c0 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efb5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776564.966478:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789776564.966584:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+44:11400:x1876716462086144:12345-192.168.202.6@tcp:36:dd.0 Request processed in 558us (972us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1789776564.966591:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 155 00000020:00080000:3.0:1789776564.966595:0:5813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789776564.973468:0:3259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efb5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.973485:0:3259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efb5c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.973507:0:3259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efb5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.973513:0:3259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681678000 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776564.973518:0:3259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efb5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.973526:0:3259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efb5c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.973543:0:3259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c8683789000) 00010000:00010000:0.0:1789776564.973546:0:3259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776564.973551:0:3259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efb5c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776564.973557:0:3259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efb5c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776565.140464:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776565.357897:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776565.357996:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462086272 00000100:00100000:3.0:1789776565.358022:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462086272 00000100:00100000:3.0:1789776565.358108:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 156 00000100:00100000:3.0:1789776565.358121:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba20d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+43:11414:x1876716462086272:12345-192.168.202.6@tcp:101:stat.0 00010000:00010000:3.0:1789776565.358146:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776565.358166:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8efb63 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c293f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.358272:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efb6a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.358288:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efb6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.358301:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efb6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.358316:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8efb71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.358323:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8efb71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.358330:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8efb71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.358417:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efb78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.358428:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efb4e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2938 expref: 44 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.358436:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efb78 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.358476:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efb4e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2938 expref: 44 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.358490:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efb4e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2938 expref: 44 pid: 8177 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776565.358505:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb56a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1876716471526016:192.168.202.6@tcp:104: 00000100:00100000:3.0:1789776565.358848:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf128cc0 going to sleep for 11 seconds 00000100:00080000:1.0:1789776565.359523:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789776565.368886:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776565.368994:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462086528 00000100:00100000:0.0:1789776565.369004:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462086528 00000100:00100000:0.0:1789776565.369078:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 43 00000100:00100000:0.0:1789776565.369089:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+45:5595:x1876716462086528:12345-192.168.202.6@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789776565.369469:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+46:5595:x1876716462086528:12345-192.168.202.6@tcp:35:ldlm_bl.0 Request processed in 380us (595us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1789776565.369477:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 43 00000100:00100000:3.0:1789776565.373296:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb56a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1876716471526016:192.168.202.6@tcp:104: 00010000:00010000:3.0:1789776565.373331:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efb78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776565.373486:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776565.373582:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462086656 00000100:00100000:2.0:1789776565.373590:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462086656 00010000:00010000:2.0:1789776565.373925:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efb4e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2938 expref: 46 pid: 8177 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776565.374029:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 66 00000100:00100000:2.0:1789776565.374055:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0795fb8a-e14a-4768-806c-f332ad101de7+46:2356:x1876716462086656:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789776565.374072:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776565.374079:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efb4e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2938 expref: 46 pid: 8177 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.374093:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efb4e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2938 expref: 46 pid: 8177 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.374116:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efb4e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2938 expref: 46 pid: 8177 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.374132:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c8683789000) 00010000:00010000:2.0:1789776565.374137:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efb78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.374147:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efb78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.374154:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efb78 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.374186:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776565.374280:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0795fb8a-e14a-4768-806c-f332ad101de7+45:2356:x1876716462086656:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 226us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776565.374287:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 66 00010000:00010000:3.0:1789776565.374353:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efb78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.374360:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efb78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776565.374410:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789776565.374415:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789776565.374441:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efb78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.374456:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efb78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.374466:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efb6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.374485:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efb6a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.374492:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efb6a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.374498:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681679c00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776565.374502:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efb6a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.374510:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efb6a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.374520:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:3.0:1789776565.374523:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776565.374526:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efb6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.374531:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efb6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.374545:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8efb71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.374551:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8efb71 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.374557:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8efb71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.374562:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681679400 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776565.374572:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8efb71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.374580:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8efb71 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.374588:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c8682cbe500) 00010000:00010000:3.0:1789776565.374590:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776565.374593:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8efb71 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.374598:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8efb71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.374665:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8efb63 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c293f expref: 45 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.374680:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efb78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c293f expref: 44 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.374687:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c8683789000) 00010000:00010000:3.0:1789776565.374689:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789776565.374691:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8681678000, rc 0) 00000100:00100000:3.0:1789776565.374719:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba20d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+44:11414:x1876716462086272:12345-192.168.202.6@tcp:101:stat.0 Request processed in 16602us (16833us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776565.376076:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 156 00000100:00100000:2.0:1789776565.466853:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776565.467028:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462086912 00000100:00100000:3.0:1789776565.467039:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462086912 00000100:00100000:3.0:1789776565.467115:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 157 00000100:00100000:3.0:1789776565.467125:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+44:11420:x1876716462086912:12345-192.168.202.6@tcp:36:truncate.0 00010000:00010000:3.0:1789776565.467198:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776565.467268:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efb78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c293f expref: 44 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.467292:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c8683789000) 00010000:00010000:3.0:1789776565.467298:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789776565.467537:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8efb7f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.467551:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8efb7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.467560:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8efb7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789776565.467615:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:3.0:1789776565.467640:0:5813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ea8b8f18 reply state 00000000ce40fd5c transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8efb7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776565.467650:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789776565.467745:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+46:11420:x1876716462086912:12345-192.168.202.6@tcp:36:truncate.0 Request processed in 621us (905us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1789776565.467753:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 157 00000020:00080000:3.0:1789776565.467757:0:5813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789776565.470161:0:3260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8efb7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.470209:0:3260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8efb7f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.470245:0:3260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8efb7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.470253:0:3260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681679200 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776565.470258:0:3260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8efb7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.470267:0:3260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8efb7f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.470284:0:3260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c8683789000) 00010000:00010000:2.0:1789776565.470287:0:3260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776565.470292:0:3260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8efb7f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.470298:0:3260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8efb7f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776565.657529:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471526144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789776565.657639:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776565.657746:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471526144 00000100:00100000:0.0:1789776565.657754:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471526144 00000100:00100000:0.0:1789776565.657815:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789776565.657825:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471526144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789776565.657864:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789776565.657911:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471526144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776565.657919:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1789776565.657941:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789776565.658389:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471526144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789776565.679109:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776565.679659:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462087040 00000100:00100000:2.0:1789776565.679671:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462087040 00000100:00100000:2.0:1789776565.679737:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 158 00000100:00100000:2.0:1789776565.679748:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb54e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+45:11435:x1876716462087040:12345-192.168.202.6@tcp:101:stat.0 00010000:00010000:2.0:1789776565.679772:0:8177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776565.679793:0:8177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efb86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2946 expref: -99 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.679879:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774000/0x26940258de8efb8d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.679894:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774000/0x26940258de8efb8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.679906:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774000/0x26940258de8efb8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.679921:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8efb94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.679928:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8efb94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.679934:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8efb94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.680495:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774e00/0x26940258de8efb9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.680507:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774e00/0x26940258de8efb9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.680515:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774e00/0x26940258de8efb9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776565.680553:0:8177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1789776565.680557:0:8177:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789776565.680578:0:8177:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774e00/0x26940258de8efb9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.680678:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774e00/0x26940258de8efb9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.680687:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774000/0x26940258de8efb8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.680695:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774000/0x26940258de8efb8d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.680702:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774000/0x26940258de8efb8d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.680708:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8686774000 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776565.680712:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774000/0x26940258de8efb8d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.680719:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774000/0x26940258de8efb8d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.680731:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:2.0:1789776565.680734:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776565.680738:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774000/0x26940258de8efb8d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.680744:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774000/0x26940258de8efb8d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.680757:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8efb94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.680763:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8efb94 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.680774:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8efb94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.680779:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8686775200 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776565.680782:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8efb94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.680788:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8efb94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.680796:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c86881a7000) 00010000:00010000:2.0:1789776565.680799:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776565.680802:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8efb94 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.680808:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8efb94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.680843:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efb86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2946 expref: 47 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.680854:0:8177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774e00/0x26940258de8efb9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2946 expref: 46 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.680861:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c8683789000) 00010000:00010000:2.0:1789776565.680863:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789776565.680866:0:8177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8686774e00, rc 0) 00000100:00100000:2.0:1789776565.680995:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb54e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+46:11435:x1876716462087040:12345-192.168.202.6@tcp:101:stat.0 Request processed in 1249us (1897us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776565.681012:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 158 00000001:00080000:0.0:1789776565.714352:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:0.0:1789776565.714370:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:3.0:1789776565.718248:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967442 is committed 00000001:00080000:3.0:1789776565.718286:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967444 is committed 00000004:00080000:3.0:1789776565.718302:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1789776565.718318:0:5833:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c86bf128e40 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1789776565.718323:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c8691f56d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c86bf128900 00000020:00080000:3.0:1789776565.718334:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c8691f56300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c86bb57c800 00000020:00080000:3.0:1789776565.718363:0:5844:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1789776565.718518:0:5844:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1789776565.718778:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789776565.718800:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb54d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471526272:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789776565.718869:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776565.718940:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471526272 00000100:00100000:2.0:1789776565.718948:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471526272 00000100:00100000:2.0:1789776565.719006:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789776565.719016:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb54f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471526272:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789776565.719043:0:6661:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:2.0:1789776565.719077:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aadd2b4, atime: 0x6aadd2b4, ctime: 0x6aadd2b4, blocks: 0xb 00010000:00010000:2.0:1789776565.719085:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045c9b3aa/0x26940258de8efba2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.719102:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=318s v=(0 0) 00010000:00010000:2.0:1789776565.719106:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776565.719113:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045c9b3aa/0x26940258de8efba2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.719128:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045c9b3aa/0x26940258de8efba2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.719138:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045c9b3aa/0x26940258de8efba2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.719146:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000045c9b3aa/0x26940258de8efba2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.719174:0:6661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789776565.719690:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb54f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3274:x1876716471526272:12345-0@lo:6:osp-syn-1-0.0 Request processed in 674us (819us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789776565.719698:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:2.0:1789776565.719726:0:8419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776565.719734:0:8419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000045c9b3aa/0x26940258de8efba2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.719743:0:8419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8686775c00 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:2.0:1789776565.719748:0:8419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000045c9b3aa/0x26940258de8efba2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.719757:0:8419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000045c9b3aa/0x26940258de8efba2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.719776:0:8419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000045c9b3aa/0x26940258de8efba2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.719784:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045c9b3aa/0x26940258de8efba2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.719804:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776565.719806:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776565.719808:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776565.719839:0:3274:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:2.0:1789776565.719846:0:3274:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:2.0:1789776565.719879:0:3274:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9c86bb54d880 x1876716471526272/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789776581 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1789776565.719890:0:3274:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c86bb54d880/2, rc 0, transno 4294967307 00000100:00100000:2.0:1789776565.719895:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb54d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471526272:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789776565.811831:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776565.811940:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462087296 00000100:00100000:2.0:1789776565.811951:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462087296 00000100:00100000:2.0:1789776565.812031:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 159 00000100:00100000:2.0:1789776565.812042:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+16:11445:x1876716462087296:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1789776565.812063:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776565.812085:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efba9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c294d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776565.812176:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789776565.812461:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efba9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c294d expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.812478:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c86a08df700) 00010000:00010000:2.0:1789776565.812481:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789776565.812487:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efba9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c294d expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776565.812502:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8686775c00, rc 0) 00000100:00100000:2.0:1789776565.812562:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+17:11445:x1876716462087296:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 522us (741us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1789776565.812582:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 159 00000100:00100000:2.0:1789776565.815949:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776565.816371:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462087552 00000100:00100000:0.0:1789776565.816382:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462087552 00000100:00100000:0.0:1789776565.816445:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 44 00000100:00100000:0.0:1789776565.816457:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a0687050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+17:11445:x1876716462087552:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:0.0:1789776565.818842:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a0687050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+18:11445:x1876716462087552:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 2379us (2893us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1789776565.818856:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 44 00000100:00100000:0.0:1789776565.946212:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776565.946382:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462087808 00000100:00100000:3.0:1789776565.946394:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462087808 00000100:00100000:3.0:1789776565.946461:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 160 00000100:00100000:3.0:1789776565.946472:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+18:11451:x1876716462087808:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:3.0:1789776565.946498:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776565.946519:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efbb7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2954 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.946634:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8efbbe lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.946657:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774e00/0x26940258de8efb9b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2946 expref: 19 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.946666:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8efbbe lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.946700:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774e00/0x26940258de8efb9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2946 expref: 19 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.946713:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774e00/0x26940258de8efb9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2946 expref: 19 pid: 8177 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776565.946728:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb56a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1876716471526400:192.168.202.6@tcp:104: 00000100:00100000:3.0:1789776565.946844:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8687ecd300 going to sleep for 11 seconds 00000100:00100000:2.0:1789776565.952900:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776565.953284:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462087936 00000100:00100000:1.0:1789776565.953295:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462087936 00010000:00010000:1.0:1789776565.953351:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774e00/0x26940258de8efb9b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2946 expref: 20 pid: 8177 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776565.953387:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 67 00000100:00100000:1.0:1789776565.953396:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0795fb8a-e14a-4768-806c-f332ad101de7+20:2355:x1876716462087936:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776565.953408:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776565.953413:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774e00/0x26940258de8efb9b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2946 expref: 20 pid: 8177 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776565.953423:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774e00/0x26940258de8efb9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2946 expref: 20 pid: 8177 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776565.953442:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c8683789000) 00010000:00010000:1.0:1789776565.953447:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8efbbe lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776565.953453:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8efbbe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776565.953458:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8efbbe lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776565.953480:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776565.953534:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0795fb8a-e14a-4768-806c-f332ad101de7+20:2355:x1876716462087936:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 139us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776565.953539:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 67 00010000:00010000:3.0:1789776565.955795:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774e00/0x26940258de8efb9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2946 expref: 19 pid: 8177 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776565.955823:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb56a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1876716471526400:192.168.202.6@tcp:104: 00010000:00010000:3.0:1789776565.955848:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8efbbe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.955858:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8efbbe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.955864:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8efbbe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776565.955885:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1789776565.956057:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efbb7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2954 expref: 20 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.956077:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8efbbe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2954 expref: 19 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.956085:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c8683789000) 00010000:00010000:3.0:1789776565.956088:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789776565.956101:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8681679400, rc 0) 00000100:00100000:3.0:1789776565.956171:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+19:11451:x1876716462087808:12345-192.168.202.6@tcp:101:bash.0 Request processed in 9700us (9970us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1789776565.956180:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 160 00000100:00100000:2.0:1789776565.960754:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776565.960822:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462088192 00000100:00100000:0.0:1789776565.960833:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462088192 00000100:00100000:0.0:1789776565.960897:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 161 00000100:00100000:0.0:1789776565.960907:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb54df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+19:11451:x1876716462088192:12345-192.168.202.6@tcp:36:bash.0 00010000:00010000:0.0:1789776565.961273:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09c00/0x26940258de8efbcc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776565.961292:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09c00/0x26940258de8efbcc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776565.961306:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09c00/0x26940258de8efbcc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789776565.961362:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1789776565.961387:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000021e39fd8 reply state 00000000b82b9130 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09c00/0x26940258de8efbcc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776565.961396:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789776565.961492:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb54df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+22:11451:x1876716462088192:12345-192.168.202.6@tcp:36:bash.0 Request processed in 585us (750us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1789776565.961499:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 161 00000020:00080000:0.0:1789776565.961505:0:5811:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789776565.963580:0:3259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09c00/0x26940258de8efbcc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.963595:0:3259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09c00/0x26940258de8efbcc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.963624:0:3259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09c00/0x26940258de8efbcc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.963631:0:3259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b09c00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776565.963636:0:3259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09c00/0x26940258de8efbcc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.963643:0:3259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09c00/0x26940258de8efbcc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.963666:0:3259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c8683789000) 00010000:00010000:3.0:1789776565.963669:0:3259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776565.963673:0:3259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09c00/0x26940258de8efbcc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776565.963679:0:3259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09c00/0x26940258de8efbcc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776565.970524:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776565.970604:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462088320 00000100:00100000:0.0:1789776565.970622:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462088320 00000100:00100000:0.0:1789776565.970675:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 162 00000100:00100000:0.0:1789776565.970683:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb54f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+21:11451:x1876716462088320:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:0.0:1789776565.970703:0:8177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776565.970722:0:8177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8efbd3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c295b expref: -99 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776565.970794:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8efbda lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776565.970805:0:8177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8efbbe lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2954 expref: 22 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776565.970823:0:8177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8efbda lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776565.970850:0:8177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8efbbe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2954 expref: 22 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776565.970860:0:8177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8efbbe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2954 expref: 22 pid: 5812 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776565.970870:0:8177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8177:1876716471526528:192.168.202.6@tcp:104: 00000100:00100000:0.0:1789776565.970941:0:8177:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86aa4a4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789776565.974479:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776565.974677:0:8177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8177:1876716471526528:192.168.202.6@tcp:104: 00010000:00010000:0.0:1789776565.974706:0:8177:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8efbda lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776565.975997:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462088448 00000100:00100000:3.0:1789776565.976009:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462088448 00010000:00010000:3.0:1789776565.976172:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8efbbe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2954 expref: 23 pid: 5812 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776565.976306:0:11144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 68 00000100:00100000:0.0:1789776565.976328:0:11144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb54c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0795fb8a-e14a-4768-806c-f332ad101de7+23:2356:x1876716462088448:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789776565.976348:0:11144:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776565.976355:0:11144:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8efbbe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2954 expref: 23 pid: 5812 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776565.976367:0:11144:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8efbbe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2954 expref: 23 pid: 5812 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776565.976393:0:11144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8efbbe lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2954 expref: 23 pid: 5812 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776565.976430:0:11144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c8683789000) 00010000:00010000:0.0:1789776565.976436:0:11144:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8efbda lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776565.976445:0:11144:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8efbda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776565.976464:0:11144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8efbda lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776565.976501:0:11144:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776565.977014:0:11144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb54c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0795fb8a-e14a-4768-806c-f332ad101de7+22:2356:x1876716462088448:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 685us (2541us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776565.977022:0:11144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 68 00010000:00010000:1.0:1789776565.979705:0:8177:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8efbda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776565.979723:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8efbda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776565.979774:0:8177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789776565.979779:0:8177:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789776565.979801:0:8177:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8efbda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776565.979845:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8efbd3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c295b expref: 22 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776565.979866:0:8177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8efbda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c295b expref: 21 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776565.979875:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c8683789000) 00010000:00010000:1.0:1789776565.979878:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789776565.979882:0:8177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86b9b09000, rc 0) 00000100:00100000:1.0:1789776565.979946:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb54f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+21:11451:x1876716462088320:12345-192.168.202.6@tcp:101:bash.0 Request processed in 9262us (9431us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776565.979953:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 162 00000100:00100000:2.0:1789776565.986075:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776565.986153:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462088704 00000100:00100000:1.0:1789776565.986176:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462088704 00000100:00100000:1.0:1789776565.986273:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 45 00000100:00100000:1.0:1789776565.986283:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb54ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+21:11451:x1876716462088704:12345-192.168.202.6@tcp:35:bash.0 00000100:00100000:1.0:1789776565.986528:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb54ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+22:11451:x1876716462088704:12345-192.168.202.6@tcp:35:bash.0 Request processed in 245us (461us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1789776565.986536:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 45 00000100:00100000:3.0:1789776566.092618:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776566.092780:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462088960 00000100:00100000:0.0:1789776566.092790:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462088960 00000100:00100000:0.0:1789776566.092851:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 163 00000100:00100000:0.0:1789776566.092861:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb56a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+22:11461:x1876716462088960:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1789776566.092886:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776566.092911:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8efbe1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2962 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776566.093013:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1789776566.093137:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8efbe1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2962 expref: 24 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776566.093152:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c86a08df700) 00010000:00010000:0.0:1789776566.093168:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789776566.093174:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8efbe1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2962 expref: 24 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776566.093189:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86b9b08a00, rc 0) 00000100:00100000:0.0:1789776566.093413:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb56a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+23:11461:x1876716462088960:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 553us (816us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1789776566.093421:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 163 00000100:00100000:2.0:1789776566.104612:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776566.104771:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462089088 00000100:00100000:3.0:1789776566.104782:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462089088 00000100:00100000:3.0:1789776566.104843:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 164 00000100:00100000:3.0:1789776566.104855:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb54c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+23:11461:x1876716462089088:12345-192.168.202.6@tcp:34:lfs.0 00010000:00010000:3.0:1789776566.104938:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efbef lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.104982:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efbef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.104995:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efbef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.105012:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efbf6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.105019:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efbf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.105026:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efbf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.105376:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efbfd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.105386:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efbfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.105394:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efbfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789776566.105449:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efbfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.105463:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efbef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.105470:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efbef lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.105488:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efbef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.105495:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681678000 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776566.105499:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efbef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.105507:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efbef lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.105519:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:3.0:1789776566.105522:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776566.105528:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efbef lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.105533:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efbef lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.105547:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efbf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.105553:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efbf6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.105558:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efbf6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.105562:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681679c00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776566.105565:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efbf6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.105580:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efbf6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.105587:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c8682cbe700) 00010000:00010000:3.0:1789776566.105589:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776566.105592:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efbf6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.105597:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efbf6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.105610:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efbfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.105616:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efbfd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.105621:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efbfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.105625:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681678a00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776566.105627:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efbfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.105632:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efbfd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.105639:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c8683789000) 00010000:00010000:3.0:1789776566.105641:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776566.105644:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efbfd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.105658:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efbfd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776566.105743:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb54c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+23:11461:x1876716462089088:12345-192.168.202.6@tcp:34:lfs.0 Request processed in 889us (1141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776566.105751:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 164 00000100:00100000:1.0:1789776566.108870:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776566.109035:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462089344 00000100:00100000:3.0:1789776566.109047:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462089344 00000100:00100000:3.0:1789776566.109099:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 46 00000100:00100000:3.0:1789776566.109108:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba20e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+23:11461:x1876716462089344:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:3.0:1789776566.109343:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba20e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+24:11461:x1876716462089344:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 236us (482us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1789776566.109351:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 46 00000100:00100000:2.0:1789776566.147540:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776566.147665:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462089600 00000100:00100000:0.0:1789776566.147676:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462089600 00000100:00100000:0.0:1789776566.147747:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 165 00000100:00100000:0.0:1789776566.147759:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb54d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+24:11464:x1876716462089600:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1789776566.147786:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776566.147810:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8efc04 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2969 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776566.147892:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08200/0x26940258de8efc0b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776566.147907:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08200/0x26940258de8efc0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776566.147918:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08200/0x26940258de8efc0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776566.147934:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8efc12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776566.147940:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8efc12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776566.147977:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8efc12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776566.148538:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09c00/0x26940258de8efc19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776566.148550:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09c00/0x26940258de8efc19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776566.148559:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09c00/0x26940258de8efc19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776566.148568:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789776566.148665:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08200/0x26940258de8efc0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776566.148674:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08200/0x26940258de8efc0b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776566.148681:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08200/0x26940258de8efc0b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776566.148687:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b08200 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776566.148692:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08200/0x26940258de8efc0b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776566.148700:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08200/0x26940258de8efc0b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776566.148712:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:0.0:1789776566.148716:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776566.148729:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08200/0x26940258de8efc0b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776566.148736:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08200/0x26940258de8efc0b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776566.148751:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8efc12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776566.148757:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8efc12 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776566.148763:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8efc12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776566.148768:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b09a00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776566.148771:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8efc12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776566.148776:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8efc12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776566.148783:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c86a08dfd00) 00010000:00010000:0.0:1789776566.148786:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776566.148788:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8efc12 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776566.148794:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8efc12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776566.148839:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8efc04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2969 expref: 27 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776566.148866:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09c00/0x26940258de8efc19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2969 expref: 26 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776566.148874:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c8683789000) 00010000:00010000:0.0:1789776566.148877:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789776566.148879:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86b9b09c00, rc 0) 00000100:00100000:0.0:1789776566.148937:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb54d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+26:11464:x1876716462089600:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 1181us (1408us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1789776566.148947:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 165 00000100:00100000:2.0:1789776566.152922:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776566.152979:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776566.153140:0:11142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462089728 00000100:00100000:1.0:1789776566.153151:0:11142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462089728 00000100:00100000:1.0:1789776566.153251:0:11142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 13 00000100:00100000:1.0:1789776566.153262:0:11142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb54e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0795fb8a-e14a-4768-806c-f332ad101de7+26:2354:x1876716462089728:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776566.153278:0:11142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776566.153306:0:11142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09c00/0x26940258de8efc19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2969 expref: 26 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.153328:0:11142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c8683789000) 00010000:00010000:1.0:1789776566.153334:0:11142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776566.153394:0:11142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb54e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0795fb8a-e14a-4768-806c-f332ad101de7+25:2354:x1876716462089728:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 134us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776566.153402:0:11142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 13 00000100:00100000:3.0:1789776566.153891:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462089856 00000100:00100000:3.0:1789776566.153897:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462089856 00000100:00100000:3.0:1789776566.153937:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 166 00000100:00100000:3.0:1789776566.153945:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb54dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+25:11464:x1876716462089856:12345-192.168.202.6@tcp:54:lfs.0 00010000:00010000:3.0:1789776566.154030:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efc27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.154047:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efc27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.154058:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efc27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.154088:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efc27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.154110:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efc27 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.154128:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efc27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.154134:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681678a00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776566.154138:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efc27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.154145:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efc27 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.154156:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c8683789000) 00010000:00010000:3.0:1789776566.154158:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789776566.154162:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efc27 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.154167:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efc27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776566.156412:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb54dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+25:11464:x1876716462089856:12345-192.168.202.6@tcp:54:lfs.0 Request processed in 2460us (3424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776566.156424:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 166 00000100:00100000:2.0:1789776566.161130:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776566.161543:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462090112 00000100:00100000:3.0:1789776566.161561:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462090112 00000100:00100000:3.0:1789776566.162337:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 47 00000100:00100000:3.0:1789776566.162356:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb54fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+25:11464:x1876716462090112:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:3.0:1789776566.162731:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb54fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+26:11464:x1876716462090112:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 381us (1608us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1789776566.162760:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 47 00010000:00010000:2.0:1789776566.164463:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776566.315939:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776566.316152:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462090368 00000100:00100000:0.0:1789776566.316168:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462090368 00000100:00100000:0.0:1789776566.316318:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 167 00000100:00100000:0.0:1789776566.316331:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba20c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+26:11482:x1876716462090368:12345-192.168.202.6@tcp:101:cat.0 00010000:00010000:0.0:1789776566.316368:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776566.316401:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8efc2e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2970 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776566.316571:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8efc35 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776566.316588:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8efc35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776566.316604:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8efc35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776566.316618:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789776566.316823:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8efc2e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2970 expref: 29 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776566.316847:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8efc35 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2970 expref: 28 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776566.316857:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c8683789000) 00010000:00010000:0.0:1789776566.316861:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789776566.316865:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86b9b09a00, rc 0) 00000100:00100000:0.0:1789776566.316953:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba20c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+28:11482:x1876716462090368:12345-192.168.202.6@tcp:101:cat.0 Request processed in 625us (1039us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1789776566.316970:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 167 00000100:00100000:2.0:1789776566.350895:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776566.351131:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462090496 00000100:00100000:1.0:1789776566.351147:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462090496 00000100:00100000:1.0:1789776566.351397:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 168 00000100:00100000:1.0:1789776566.351412:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb54c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+28:11483:x1876716462090496:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1789776566.351449:0:8177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776566.351498:0:8177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8efc43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2977 expref: -99 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.351593:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca800/0x26940258de8efc4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.351625:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca800/0x26940258de8efc4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.351639:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca800/0x26940258de8efc4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776566.351692:0:8177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1789776566.351696:0:8177:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789776566.351721:0:8177:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca800/0x26940258de8efc4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.351756:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8efc43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2977 expref: 30 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.351789:0:8177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca800/0x26940258de8efc4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2977 expref: 29 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.351798:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:1.0:1789776566.351801:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789776566.351806:0:8177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86bf5ca800, rc 0) 00000100:00100000:1.0:1789776566.351899:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb54c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+29:11483:x1876716462090496:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 492us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776566.351907:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 168 00000100:00100000:2.0:1789776566.360526:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776566.360634:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462090880 00000100:00100000:0.0:1789776566.360651:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462090880 00000100:00100000:0.0:1789776566.360714:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 48 00000100:00100000:0.0:1789776566.360723:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb54ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+29:11483:x1876716462090880:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:0.0:1789776566.361735:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb54ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+30:11483:x1876716462090880:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 882us (1091us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1789776566.361747:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 48 00000100:00100000:2.0:1789776566.364724:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776566.364810:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462091008 00000100:00100000:1.0:1789776566.364841:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462091008 00000100:00100000:1.0:1789776566.364921:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 14 00000100:00100000:1.0:1789776566.364933:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c869880ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0795fb8a-e14a-4768-806c-f332ad101de7+30:11483:x1876716462091008:12345-192.168.202.6@tcp:103:lfs.0 00010000:00010000:1.0:1789776566.364956:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789776566.365006:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8efbda lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c295b expref: 30 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.365029:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8efc35 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2970 expref: 29 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.365041:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8efade lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c291c expref: 28 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.365052:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c8683789000) 00010000:00010000:1.0:1789776566.365072:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776566.365142:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c869880ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0795fb8a-e14a-4768-806c-f332ad101de7+27:11483:x1876716462091008:12345-192.168.202.6@tcp:103:lfs.0 Request processed in 210us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776566.365151:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 14 00000100:00100000:2.0:1789776566.368009:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776566.368129:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462091136 00000100:00100000:0.0:1789776566.368142:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462091136 00000100:00100000:0.0:1789776566.368369:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 169 00000100:00100000:0.0:1789776566.368383:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb54d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+27:11483:x1876716462091136:12345-192.168.202.6@tcp:58:lfs.0 00010000:00010000:0.0:1789776566.368538:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8efc51 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776566.368560:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8efc51 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776566.368594:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8efc51 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789776566.369083:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1789776566.369198:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb54d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+27:11483:x1876716462091136:12345-192.168.202.6@tcp:58:lfs.0 Request processed in 817us (1204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776566.369207:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 169 00000100:00100000:2.0:1789776566.389967:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776566.390342:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462091264 00000100:00100000:3.0:1789776566.390356:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462091264 00000100:00100000:2.0:1789776566.390900:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 170 00000100:00100000:2.0:1789776566.390915:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb54f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+27:11485:x1876716462091264:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1789776566.390944:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776566.390986:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774000/0x26940258de8efc58 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c297e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776566.391103:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774e00/0x26940258de8efc5f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776566.391123:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774e00/0x26940258de8efc5f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776566.391136:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774e00/0x26940258de8efc5f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776566.391179:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efc66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776566.391188:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efc66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776566.391195:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efc66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776566.391593:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8efc6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776566.391604:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8efc6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776566.391621:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8efc6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776566.391859:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789776566.391866:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789776566.391897:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8efc6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776566.391914:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8efc6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776566.391924:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774e00/0x26940258de8efc5f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776566.391931:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774e00/0x26940258de8efc5f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776566.391951:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774e00/0x26940258de8efc5f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776566.391967:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8686774e00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776566.391972:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774e00/0x26940258de8efc5f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776566.391982:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774e00/0x26940258de8efc5f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776566.391996:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:2.0:1789776566.391999:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776566.392004:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774e00/0x26940258de8efc5f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776566.392011:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774e00/0x26940258de8efc5f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776566.392026:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efc66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776566.392032:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efc66 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776566.392038:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efc66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776566.392043:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8686775c00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776566.392045:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efc66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776566.392060:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efc66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776566.392068:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c86881a7b00) 00010000:00010000:2.0:1789776566.392070:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776566.392072:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efc66 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776566.392078:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efc66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776566.392288:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774000/0x26940258de8efc58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c297e expref: 29 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776566.392307:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8efc6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c297e expref: 28 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776566.392315:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c86a08dfd00) 00010000:00010000:2.0:1789776566.392317:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789776566.392320:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8686775200, rc 0) 00000100:00100000:2.0:1789776566.392423:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb54f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+28:11485:x1876716462091264:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 1511us (2481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776566.392432:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 170 00000100:00100000:0.0:1789776566.676571:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c8582a70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3276:1876716471526912:0@lo:400:kworker.0 00000100:00100000:0.0:1789776566.676645:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776566.676726:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789776566.676732:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876716471526784:0@lo:400:kworker.0 00000100:00100000:0.0:1789776566.676757:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776566.676773:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471527296:0@lo:400:kworker.0 00000100:00100000:0.0:1789776566.676794:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776566.676824:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471526912 00000100:00100000:0.0:1789776566.676831:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471526912 00000100:00100000:2.0:1789776566.679308:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9db43398-240e-4f78-8778-c11d527e09a1:3274:1876716471526656:0@lo:400:kworker.0 00000100:00100000:2.0:1789776566.679392:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776566.679440:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3274:1876716471527168:0@lo:400:kworker.0 00000100:00100000:2.0:1789776566.679470:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776566.679523:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789776566.679530:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c8582a71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471527040:0@lo:400:kworker.0 00000100:00100000:2.0:1789776566.679558:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776566.679596:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471526784 00000100:00100000:2.0:1789776566.679604:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471526784 00000100:00100000:1.0:1789776566.679691:0:8384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471527296 00000100:00100000:1.0:1789776566.679696:0:8384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471527296 00000100:00100000:1.0:1789776566.679748:0:8384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471527040 00000100:00100000:1.0:1789776566.679752:0:8384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471527040 00000100:00100000:1.0:1789776566.679776:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789776566.679785:0:8384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba376d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3276:x1876716471527296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776566.679843:0:8384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba376d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3276:x1876716471527296:12345-0@lo:400:kworker.0 Request processed in 59us (3047us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776566.679850:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789776566.679865:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789776566.679878:0:8384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471527040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776566.679911:0:8384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471527040:12345-0@lo:400:kworker.0 Request processed in 33us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776566.679917:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789776566.679943:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471527168 00000100:00100000:1.0:1789776566.679947:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471527168 00000100:00100000:3.0:1789776566.680012:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471526656 00000100:00100000:3.0:1789776566.680016:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471526656 00000100:00100000:3.0:1789776566.680045:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1789776566.680050:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa597850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+19:3274:x1876716471526656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776566.680081:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa597850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+19:3274:x1876716471526656:12345-0@lo:400:kworker.0 Request processed in 31us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776566.680086:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1789776566.680207:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789776566.680276:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789776566.680282:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876716471526784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776566.680314:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876716471526784:12345-0@lo:400:kworker.0 Request processed in 32us (3556us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776566.680319:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789776566.680360:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c8582a71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471527040:0@lo:400:kworker.0 00000100:00100000:2.0:1789776566.680369:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9db43398-240e-4f78-8778-c11d527e09a1:3274:1876716471526656:0@lo:400:kworker.0 00000100:00100000:1.0:1789776566.689236:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789776566.689253:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb54ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1876716471527168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776566.689376:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb54ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1876716471527168:12345-0@lo:400:kworker.0 Request processed in 128us (9904us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776566.689383:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:1.0:1789776566.689433:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789776566.689439:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789776566.689492:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876716471526784:0@lo:400:kworker.0 00000100:00100000:1.0:1789776566.689506:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471527296:0@lo:400:kworker.0 00000100:00100000:3.0:1789776566.689624:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3274:1876716471527168:0@lo:400:kworker.0 00000100:00100000:0.0:1789776566.690341:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876716471526912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776566.690406:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876716471526912:12345-0@lo:400:kworker.0 Request processed in 10192us (13761us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776566.690414:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789776566.690692:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c8582a70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3276:1876716471526912:0@lo:400:kworker.0 00000040:00080000:2.0:1789776566.869616:0:11658:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789776566.869628:0:11658:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789776566.869692:0:11658:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1789776566.869700:0:11658:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789776566.869873:0:11658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb54c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11658:1876716471527424:192.168.202.6@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789776566.870001:0:11658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86878f0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789776566.874102:0:11658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb54c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11658:1876716471527424:192.168.202.6@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789776566.878757:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776566.878798:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462091392 00000100:00100000:3.0:1789776566.878808:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462091392 00000100:00100000:3.0:1789776566.878873:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 171 00000100:00100000:3.0:1789776566.878884:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+28:11496:x1876716462091392:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789776566.878922:0:5812:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789776566.879077:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+28:11496:x1876716462091392:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 Request processed in 195us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776566.879086:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 171 00000100:00100000:3.0:1789776566.891007:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776566.891301:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462091520 00000100:00100000:1.0:1789776566.891324:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462091520 00000100:00100000:1.0:1789776566.891385:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 172 00000100:00100000:1.0:1789776566.891395:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+28:11496:x1876716462091520:12345-192.168.202.6@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789776566.891471:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8efc74 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.891490:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8efc74 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.891503:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8efc74 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.891533:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8efc7b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.891541:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8efc7b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.891548:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8efc7b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.891576:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efc82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.891584:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efc82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.891590:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efc82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776566.891648:0:8177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789776566.891653:0:8177:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789776566.891667:0:8177:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efc82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.891679:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8efc74 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.891685:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8efc74 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.891692:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8efc74 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.891710:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5ca200 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776566.891716:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8efc74 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.891724:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8efc74 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.891738:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c8683789100) 00010000:00010000:1.0:1789776566.891741:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776566.891747:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8efc74 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.891752:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8efc74 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.891766:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8efc7b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.891773:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8efc7b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.891779:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8efc7b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.891783:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5cb200 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776566.891786:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8efc7b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.891792:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8efc7b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.891812:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9c8683789000) 00010000:00010000:1.0:1789776566.891815:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776566.891818:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8efc7b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.891824:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8efc7b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.891843:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efc82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.891864:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efc82 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.891869:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efc82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.891873:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5ca600 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776566.891876:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efc82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.891882:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efc82 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.891888:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c86a08dfd00) 00010000:00010000:1.0:1789776566.891890:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776566.891893:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efc82 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.891897:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efc82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776566.891990:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+28:11496:x1876716462091520:12345-192.168.202.6@tcp:34:lhsmtool_posix.0 Request processed in 595us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776566.891998:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 172 00000100:00100000:1.0:1789776566.895165:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776566.895198:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462091776 00000100:00100000:1.0:1789776566.895207:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462091776 00000100:00100000:1.0:1789776566.895272:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 173 00000100:00100000:1.0:1789776566.895281:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba20ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+28:11496:x1876716462091776:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789776566.895300:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776566.895331:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8efc89 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2985 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.895427:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efc90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.895441:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efc90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.895452:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efc90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776566.895462:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789776566.895559:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efc90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.895567:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efc90 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.895575:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efc90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.895595:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5caa00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776566.895599:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efc90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.895607:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efc90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.895619:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c86a08dfd00) 00010000:00010000:1.0:1789776566.895622:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789776566.895627:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efc90 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.895634:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efc90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.895675:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8efc89 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2985 expref: 30 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.895686:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c8683789100) 00010000:00010000:1.0:1789776566.895688:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789776566.895692:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8efc89 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2985 expref: 30 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776566.895700:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86bf5cae00, rc 0) 00000100:00100000:1.0:1789776566.895752:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba20ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+29:11496:x1876716462091776:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 473us (598us total) trans 4294967457 rc 301/301 00000100:00100000:1.0:1789776566.895760:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 173 00000100:00100000:1.0:1789776566.904482:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776566.904657:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462091904 00000100:00100000:2.0:1789776566.904667:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462091904 00000100:00100000:2.0:1789776566.904718:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 174 00000100:00100000:2.0:1789776566.904727:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba20ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+29:11496:x1876716462091904:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789776566.904760:0:8177:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789776566.904870:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba20ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+29:11496:x1876716462091904:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 Request processed in 143us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776566.904886:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 174 00000100:00100000:1.0:1789776566.922828:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776566.925466:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462092160 00000100:00100000:3.0:1789776566.925482:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462092160 00000100:00100000:3.0:1789776566.925943:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 175 00000100:00100000:3.0:1789776566.925965:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba20f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+29:11496:x1876716462092160:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789776566.926002:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776566.926005:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789776566.926035:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca800/0x26940258de8efc4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2977 expref: 29 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.926052:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:3.0:1789776566.926057:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789776566.926083:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efc9e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c298c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789776566.927296:0:5812:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1789776566.928457:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efca5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.928587:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efca5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.928600:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efca5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.928802:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efc9e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c298c expref: 31 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.928822:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efca5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c298c expref: 30 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.928829:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c8682cbe700) 00010000:00010000:3.0:1789776566.928832:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789776566.928843:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8681679c00, rc 0) 00000100:00100000:3.0:1789776566.929000:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba20f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+30:11496:x1876716462092160:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 3047us (6180us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1789776566.929008:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 175 00000100:00100000:0.0:1789776566.939524:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776566.939602:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462092416 00000100:00100000:2.0:1789776566.939622:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462092416 00000100:00100000:2.0:1789776566.939756:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 176 00000100:00100000:2.0:1789776566.939768:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+30:11496:x1876716462092416:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789776566.939826:0:8177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776566.941357:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efca5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c298c expref: 30 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776566.941386:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c8682cbe700) 00010000:00010000:2.0:1789776566.941400:0:8177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789776566.941503:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774000/0x26940258de8efcb3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776566.941522:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774000/0x26940258de8efcb3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776566.941533:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774000/0x26940258de8efcb3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776566.941610:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efcba lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x6dbb9f67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776566.941619:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efcba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6dbb9f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776566.941626:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efcba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6dbb9f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776566.942064:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774000/0x26940258de8efcb3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776566.942268:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774000/0x26940258de8efcb3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776566.942275:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774000/0x26940258de8efcb3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776566.942281:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8686774000 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776566.942285:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774000/0x26940258de8efcb3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776566.942292:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774000/0x26940258de8efcb3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776566.942493:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:2.0:1789776566.942497:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776566.942503:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774000/0x26940258de8efcb3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776566.942510:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774000/0x26940258de8efcb3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776566.942522:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efcba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6dbb9f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776566.942528:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efcba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6dbb9f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776566.942533:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efcba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6dbb9f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776566.942538:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8686775c00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776566.942548:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efcba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6dbb9f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776566.942838:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efcba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6dbb9f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776566.942920:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x6dbb9f67 (ffff9c86881a7b00) 00010000:00010000:2.0:1789776566.942923:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776566.942928:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efcba lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x6dbb9f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776566.942934:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efcba lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x6dbb9f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776566.943059:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+29:11496:x1876716462092416:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 Request processed in 3290us (3542us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789776566.944829:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 176 00000100:00100000:1.0:1789776566.950399:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776566.951047:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462092544 00000100:00100000:0.0:1789776566.951059:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462092544 00000100:00100000:0.0:1789776566.951133:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 177 00000100:00100000:0.0:1789776566.951144:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba20ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+29:11496:x1876716462092544:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789776566.951178:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776566.951202:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08200/0x26940258de8efcc1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2993 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776566.951270:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09600/0x26940258de8efcc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776566.951284:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09600/0x26940258de8efcc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776566.951296:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09600/0x26940258de8efcc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776566.951402:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08200/0x26940258de8efcc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2993 expref: 31 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776566.951725:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09600/0x26940258de8efcc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2993 expref: 30 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776566.951736:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c86a08df300) 00010000:00010000:0.0:1789776566.951739:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789776566.951743:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86b9b09600, rc 0) 00000100:00100000:0.0:1789776566.951811:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba20ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+30:11496:x1876716462092544:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 669us (1419us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776566.951819:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 177 00000100:00100000:1.0:1789776566.977149:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776566.977299:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462092800 00000100:00100000:3.0:1789776566.977309:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462092800 00000100:00100000:3.0:1789776566.977357:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 178 00000100:00100000:3.0:1789776566.977366:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba20d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+30:11496:x1876716462092800:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789776566.977444:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efccf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.977461:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efccf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.977471:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efccf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789776566.977831:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1789776566.977841:0:5813:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 319757623828ns, next at 320757621674ns, rc = 0 00000004:00010000:3.0:1789776566.977942:0:5813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000bb2d9b0 reply state 000000002f697fc2 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efccf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776566.977951:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789776566.978053:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba20d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+32:11496:x1876716462092800:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 Request processed in 687us (913us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1789776566.978060:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 178 00010000:00010000:3.0:1789776566.980695:0:3260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efccf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.980710:0:3260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efccf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.980731:0:3260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efccf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.980736:0:3260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681678a00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776566.980741:0:3260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efccf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.980748:0:3260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efccf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.980763:0:3260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c86a08df300) 00010000:00010000:3.0:1789776566.980766:0:3260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789776566.980770:0:3260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efccf lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776566.980777:0:3260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efccf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776566.981425:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776566.981814:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462092928 00000100:00100000:0.0:1789776566.981825:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462092928 00000100:00100000:0.0:1789776566.981944:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 179 00000100:00100000:0.0:1789776566.981966:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba20ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+31:11496:x1876716462092928:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789776566.981997:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776566.982015:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08200/0x26940258de8efcd6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c299a expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776566.982134:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08200/0x26940258de8efcd6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c299a expref: 32 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776566.982149:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08200/0x26940258de8efcd6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c299a expref: 32 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776566.982170:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c86a08df300) 00010000:00010000:0.0:1789776566.982173:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789776566.982177:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86b9b08200, rc 0) 00000100:00100000:0.0:1789776566.982992:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba20ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+32:11496:x1876716462092928:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 1034us (1567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776566.983000:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 179 00000100:00100000:0.0:1789776566.994806:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776566.995972:0:8384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462093056 00000100:00100000:1.0:1789776566.995983:0:8384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462093056 00000100:00100000:1.0:1789776566.996056:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 51 00000100:00100000:1.0:1789776566.996700:0:8384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a0b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0795fb8a-e14a-4768-806c-f332ad101de7+6:2355:x1876716462093056:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1789776566.997725:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789776566.999315:0:8384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a0b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0795fb8a-e14a-4768-806c-f332ad101de7+7:2355:x1876716462093056:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 Request processed in 3241us (4508us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1789776566.999327:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 51 00000100:00100000:1.0:1789776567.004394:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776567.004707:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462093312 00000100:00100000:0.0:1789776567.004718:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462093312 00000100:00100000:0.0:1789776567.004791:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 49 00000100:00100000:0.0:1789776567.004802:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba20fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+32:11496:x1876716462093312:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 00000100:00080000:1.0:1789776567.005237:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789776567.005939:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba20fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+33:11496:x1876716462093312:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 Request processed in 264us (679us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1789776567.005964:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 49 00000100:00100000:3.0:1789776567.009589:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776567.009843:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462093568 00000100:00100000:0.0:1789776567.009870:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462093568 00000100:00100000:0.0:1789776567.010988:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 180 00000100:00100000:0.0:1789776567.011004:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb56b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+33:11496:x1876716462093568:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789776567.011132:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb56b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+33:11496:x1876716462093568:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 132us (1550us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776567.011142:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 180 00000100:00100000:0.0:1789776567.017044:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776567.017185:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462093696 00000100:00100000:3.0:1789776567.017196:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462093696 00000100:00100000:3.0:1789776567.017292:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 181 00000100:00100000:3.0:1789776567.017303:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a0b58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+33:11496:x1876716462093696:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789776567.017326:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776567.017351:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efcdd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c29a1 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776567.017442:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efce4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776567.017469:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efce4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776567.017482:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efce4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776567.017521:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789776567.017539:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efce4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776567.017567:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efcdd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29a1 expref: 35 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776567.017587:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efce4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29a1 expref: 34 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776567.017595:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c86a08df300) 00010000:00010000:3.0:1789776567.017598:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789776567.017602:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8681678000, rc 0) 00000100:00100000:3.0:1789776567.017736:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a0b58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+34:11496:x1876716462093696:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 435us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776567.017743:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 181 00000100:00100000:3.0:1789776567.023411:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776567.023509:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462093824 00000100:00100000:0.0:1789776567.023519:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462093824 00000100:00100000:0.0:1789776567.023577:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 52 00000100:00100000:0.0:1789776567.023587:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb56b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0795fb8a-e14a-4768-806c-f332ad101de7+7:2354:x1876716462093824:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789776567.023613:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776567.023633:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b072e5d8/0x26940258de8efceb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c29a8 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789776567.023665:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aadd2b7, blocks: 0x1 00010000:00010000:0.0:1789776567.023684:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=319s v=(0 0) 00010000:00010000:0.0:1789776567.023689:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789776567.023698:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b072e5d8/0x26940258de8efceb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29a8 expref: 8 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776567.023718:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b072e5d8/0x26940258de8efceb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29a8 expref: 8 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776567.023731:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86b9b09800, rc 0) 00000100:00100000:0.0:1789776567.023780:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb56b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0795fb8a-e14a-4768-806c-f332ad101de7+8:2354:x1876716462093824:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 194us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776567.023797:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 52 00000100:00100000:2.0:1789776567.029397:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776567.029457:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462094080 00000100:00100000:1.0:1789776567.029468:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462094080 00000100:00100000:1.0:1789776567.029524:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 182 00000100:00100000:1.0:1789776567.029533:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb54c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+34:11496:x1876716462094080:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789776567.029652:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb54c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+34:11496:x1876716462094080:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 120us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776567.029660:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 182 00000100:00100000:0.0:1789776567.035300:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776567.035402:0:8384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462094208 00000100:00100000:3.0:1789776567.035413:0:8384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462094208 00000100:00100000:3.0:1789776567.035477:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 53 00000100:00100000:3.0:1789776567.035488:0:8384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a0b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0795fb8a-e14a-4768-806c-f332ad101de7+8:11496:x1876716462094208:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789776567.035508:0:8384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776567.035539:0:8384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057f050f3/0x26940258de8efcf2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c29af expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776567.035574:0:8384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b072e5d8/0x26940258de8efceb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29a8 expref: 9 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776567.035584:0:8384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789776567.035588:0:8384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789776567.035594:0:8384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057f050f3/0x26940258de8efcf2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29af expref: 9 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776567.035653:0:8384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b072e5d8/0x26940258de8efceb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29a8 expref: 9 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776567.035669:0:8384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b072e5d8/0x26940258de8efceb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29a8 expref: 9 pid: 6659 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776567.035682:0:8384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9de4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8384:1876716471527552:192.168.202.6@tcp:104: 00000100:00100000:3.0:1789776567.035767:0:8384:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8687ecd540 going to sleep for 11 seconds 00000100:00100000:3.0:1789776567.041613:0:8384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9de4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8384:1876716471527552:192.168.202.6@tcp:104: 00010000:00010000:3.0:1789776567.041650:0:8384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000057f050f3/0x26940258de8efcf2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29af expref: 9 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776567.041675:0:8384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8681678800, rc 0) 00000100:00100000:2.0:1789776567.041962:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776567.041995:0:11144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462094336 00000100:00100000:2.0:1789776567.042002:0:11144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462094336 00010000:00010000:2.0:1789776567.042036:0:11144:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b072e5d8/0x26940258de8efceb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29a8 expref: 10 pid: 6659 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776567.042080:0:11144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 69 00000100:00100000:2.0:1789776567.042090:0:11144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb54e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0795fb8a-e14a-4768-806c-f332ad101de7+10:2357:x1876716462094336:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789776567.042105:0:11144:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776567.042128:0:11144:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b072e5d8/0x26940258de8efceb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29a8 expref: 10 pid: 6659 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.042160:0:11144:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b072e5d8/0x26940258de8efceb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29a8 expref: 10 pid: 6659 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.042184:0:11144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b072e5d8/0x26940258de8efceb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29a8 expref: 10 pid: 6659 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.042196:0:11144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776567.042200:0:11144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776567.042208:0:11144:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000057f050f3/0x26940258de8efcf2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29af expref: 9 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.042237:0:11144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057f050f3/0x26940258de8efcf2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29af expref: 9 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.042271:0:11144:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000057f050f3/0x26940258de8efcf2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29af expref: 9 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776567.042284:0:11144:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6f1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:11144:1876716471527680:192.168.202.6@tcp:105: 00000100:00100000:2.0:1789776567.042336:0:11144:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86878f09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776567.043990:0:8384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a0b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0795fb8a-e14a-4768-806c-f332ad101de7+9:11496:x1876716462094208:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 8495us (8690us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776567.044010:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 53 00000100:00100000:2.0:1789776567.058742:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776567.058841:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462094464 00000100:00100000:1.0:1789776567.058851:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462094464 00002000:00100000:1.0:1789776567.058903:0:6666:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9c86ba6f3b80 x1876716462094464/t0(0) o4->0795fb8a-e14a-4768-806c-f332ad101de7@192.168.202.6@tcp:3/0 lens 504/0 e 0 to 0 dl 1789776578 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789776567.058915:0:6666:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c86ba6f3b80 with x1876716462094464 ext(0->8) 00002000:00010000:1.0:1789776567.058920:0:6666:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c86ba6f3b80 00000100:00100000:1.0:1789776567.058977:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4 00000100:00100000:1.0:1789776567.058987:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0795fb8a-e14a-4768-806c-f332ad101de7+9:2355:x1876716462094464:12345-192.168.202.6@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789776567.059476:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0795fb8a-e14a-4768-806c-f332ad101de7+11:2355:x1876716462094464:12345-192.168.202.6@tcp:4:lhsmtool_posix.0 Request processed in 489us (741us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1789776567.059485:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4 00002000:00100000:1.0:1789776567.059492:0:6666:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9c86ba6f3b80 x1876716462094464/t4294967314(0) o4->0795fb8a-e14a-4768-806c-f332ad101de7@192.168.202.6@tcp:3/0 lens 504/448 e 0 to 0 dl 1789776578 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789776567.059500:0:6666:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c86ba6f3b80 with x1876716462094464 ext(0->8) 00002000:00010000:1.0:1789776567.059503:0:6666:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c86ba6f3b80 00000100:00100000:0.0:1789776567.061528:0:11144:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6f1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:11144:1876716471527680:192.168.202.6@tcp:105: 00010000:00010000:0.0:1789776567.061556:0:11144:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776567.061631:0:11144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb54e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0795fb8a-e14a-4768-806c-f332ad101de7+10:2357:x1876716462094336:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 19541us (19679us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776567.062182:0:11144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 69 00000100:00100000:0.0:1789776567.069865:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776567.069945:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462094592 00000100:00100000:3.0:1789776567.069964:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462094592 00000100:00100000:3.0:1789776567.070022:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 183 00000100:00100000:3.0:1789776567.070032:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a0b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+34:11496:x1876716462094592:12345-192.168.202.6@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789776567.116659:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:1.0:1789776567.116710:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:1.0:1789776567.116741:0:5833:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:2.0:1789776567.116977:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789776567.117000:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471527808:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789776567.117084:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776567.117157:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471527808 00000100:00100000:2.0:1789776567.117180:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471527808 00000100:00100000:2.0:1789776567.117268:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789776567.117278:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471527808:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789776567.117452:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789776567.117456:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789776567 00002000:00010000:2.0:1789776567.117458:0:6659:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789776567.117460:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789776567 -> 1789776567 00002000:00010000:2.0:1789776567.117462:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789776567.117502:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3275:x1876716471527808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 226us (418us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789776567.117509:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1789776567.117531:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1789776567.117565:0:3275:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c86ba6f1880/2, rc 0, transno 4294967315 00000100:00100000:2.0:1789776567.117571:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471527808:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789776567.119058:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a0b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+18:11496:x1876716462094592:12345-192.168.202.6@tcp:44:lhsmtool_posix.0 Request processed in 48025us (48201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776567.120712:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 183 00000020:00080000:3.0:1789776567.120756:0:5844:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1789776567.120768:0:5844:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1789776567.121618:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776567.126129:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462094720 00000100:00100000:1.0:1789776567.126146:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462094720 00000100:00100000:1.0:1789776567.126278:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 55 00000100:00100000:1.0:1789776567.126288:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9de4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+10:2357:x1876716462094720:12345-192.168.202.6@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1789776567.189930:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776567.194648:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a0b5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471527936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789776567.194730:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776567.194798:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471527936 00000100:00100000:0.0:1789776567.194806:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471527936 00000100:00100000:0.0:1789776567.194851:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789776567.194860:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af280c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3273:x1876716471527936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789776567.194897:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789776567.194940:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af280c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3273:x1876716471527936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776567.194947:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789776567.195204:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a0b5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471527936:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1789776567.216463:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:0.0:1789776567.216484:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:0.0:1789776567.217455:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9de4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+7:2357:x1876716462094720:12345-192.168.202.6@tcp:16:lhsmtool_posix.0 Request processed in 91161us (95833us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776567.217468:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 55 00000100:00100000:1.0:1789776567.230391:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776567.230480:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462094976 00000100:00100000:2.0:1789776567.230491:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462094976 00000100:00100000:2.0:1789776567.230562:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 184 00000100:00100000:2.0:1789776567.230574:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+18:11496:x1876716462094976:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789776567.230629:0:8177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776567.230660:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efce4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29a1 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.230680:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c86a08df300) 00010000:00010000:2.0:1789776567.230684:0:8177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789776567.230715:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774c00/0x26940258de8efcf9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.230728:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774c00/0x26940258de8efcf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.230746:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774c00/0x26940258de8efcf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789776567.231023:0:8177:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b7d8cb9a reply state 000000005f651e9e transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774c00/0x26940258de8efcf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776567.231033:0:8177:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789776567.231180:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+19:11496:x1876716462094976:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 Request processed in 608us (799us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1789776567.231188:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 184 00010000:00010000:3.0:1789776567.233748:0:3259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774c00/0x26940258de8efcf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776567.233766:0:3259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774c00/0x26940258de8efcf9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776567.233776:0:3259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774c00/0x26940258de8efcf9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776567.233785:0:3259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8686774c00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776567.233791:0:3259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774c00/0x26940258de8efcf9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776567.233800:0:3259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774c00/0x26940258de8efcf9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776567.233822:0:3259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c86a08df300) 00010000:00010000:3.0:1789776567.233835:0:3259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776567.233841:0:3259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774c00/0x26940258de8efcf9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776567.233849:0:3259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774c00/0x26940258de8efcf9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776567.243020:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776567.243100:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462095104 00000100:00100000:0.0:1789776567.243120:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462095104 00000100:00100000:0.0:1789776567.243185:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 56 00000100:00100000:0.0:1789776567.243197:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0795fb8a-e14a-4768-806c-f332ad101de7+7:2356:x1876716462095104:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789776567.243535:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1789776567.243540:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789776567 -> 1789776566 00002000:00010000:0.0:1789776567.243548:0:6659:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789776564 00002000:00010000:0.0:1789776567.243550:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789776567 -> 1789776566 00002000:00010000:0.0:1789776567.243556:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789776567.243617:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0795fb8a-e14a-4768-806c-f332ad101de7+8:2356:x1876716462095104:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 Request processed in 421us (606us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1789776567.243626:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 56 00000100:00100000:0.0:1789776567.257084:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776567.260537:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462095360 00000100:00100000:2.0:1789776567.260551:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462095360 00000100:00100000:2.0:1789776567.260722:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 185 00000100:00100000:2.0:1789776567.260734:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a0b5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+18:11496:x1876716462095360:12345-192.168.202.6@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789776567.260810:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774600/0x26940258de8efd00 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.260828:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09600/0x26940258de8efcc8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2993 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.260839:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774600/0x26940258de8efd00 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.260873:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09600/0x26940258de8efcc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2993 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.260888:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09600/0x26940258de8efcc8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2993 expref: 18 pid: 5811 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776567.260912:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c8582a71500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1876716471528064:192.168.202.6@tcp:104: 00000100:00100000:2.0:1789776567.261019:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8699ba3540 going to sleep for 11 seconds 00000100:00100000:1.0:1789776567.268434:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776567.268807:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c8582a71500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1876716471528064:192.168.202.6@tcp:104: 00010000:00010000:0.0:1789776567.268840:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774600/0x26940258de8efd00 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776567.268899:0:11142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462095488 00000100:00100000:1.0:1789776567.268907:0:11142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462095488 00010000:00010000:1.0:1789776567.268948:0:11142:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09600/0x26940258de8efcc8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2993 expref: 19 pid: 5811 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776567.269002:0:11142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 70 00000100:00100000:1.0:1789776567.269012:0:11142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0795fb8a-e14a-4768-806c-f332ad101de7+19:2357:x1876716462095488:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776567.269029:0:11142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776567.269049:0:11142:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09600/0x26940258de8efcc8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2993 expref: 19 pid: 5811 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776567.269065:0:11142:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09600/0x26940258de8efcc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2993 expref: 19 pid: 5811 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776567.269091:0:11142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09600/0x26940258de8efcc8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2993 expref: 19 pid: 5811 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776567.269108:0:11142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c86a08df300) 00010000:00010000:1.0:1789776567.269114:0:11142:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774600/0x26940258de8efd00 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776567.269244:0:11142:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774600/0x26940258de8efd00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776567.269252:0:11142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774600/0x26940258de8efd00 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776567.269277:0:11142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776567.269332:0:11142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0795fb8a-e14a-4768-806c-f332ad101de7+18:2357:x1876716462095488:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 321us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776567.269340:0:11142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 70 00010000:00010000:0.0:1789776567.269485:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774600/0x26940258de8efd00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776567.269493:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774600/0x26940258de8efd00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776567.269526:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774600/0x26940258de8efd00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776567.269533:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774600/0x26940258de8efd00 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776567.269540:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774600/0x26940258de8efd00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776567.269553:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8686774600 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776567.269557:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774600/0x26940258de8efd00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776567.269566:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774600/0x26940258de8efd00 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776567.269576:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c86a08df300) 00010000:00010000:0.0:1789776567.269578:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789776567.269582:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774600/0x26940258de8efd00 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776567.269587:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774600/0x26940258de8efd00 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776567.269644:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a0b5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+17:11496:x1876716462095360:12345-192.168.202.6@tcp:55:lhsmtool_posix.0 Request processed in 8913us (12567us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789776567.269652:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 185 00000100:00100000:3.0:1789776567.278262:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776567.278303:0:8384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462095616 00000100:00100000:3.0:1789776567.278311:0:8384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462095616 00000100:00100000:3.0:1789776567.278360:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 57 00000100:00100000:3.0:1789776567.278369:0:8384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9de4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0795fb8a-e14a-4768-806c-f332ad101de7+8:2356:x1876716462095616:12345-192.168.202.6@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789776567.278412:0:8384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008688fcc9/0x26940258de8efd07 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776567.278434:0:8384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000057f050f3/0x26940258de8efcf2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29af expref: 8 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776567.278443:0:8384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789776567.278448:0:8384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789776567.278452:0:8384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008688fcc9/0x26940258de8efd07 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776567.278488:0:8384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000057f050f3/0x26940258de8efcf2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29af expref: 8 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776567.278503:0:8384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000057f050f3/0x26940258de8efcf2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29af expref: 8 pid: 8384 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776567.278533:0:8384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9de7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8384:1876716471528192:192.168.202.6@tcp:104: 00000100:00100000:3.0:1789776567.278608:0:8384:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8687ecd6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776567.282347:0:8384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9de7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8384:1876716471528192:192.168.202.6@tcp:104: 00010000:00010000:3.0:1789776567.282381:0:8384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008688fcc9/0x26940258de8efd07 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776567.288860:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776567.292976:0:11143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462095744 00000100:00100000:2.0:1789776567.292995:0:11143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462095744 00010000:00010000:2.0:1789776567.293053:0:11143:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000057f050f3/0x26940258de8efcf2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29af expref: 9 pid: 8384 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776567.293111:0:11143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 71 00000100:00100000:2.0:1789776567.293130:0:11143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9de7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0795fb8a-e14a-4768-806c-f332ad101de7+9:2356:x1876716462095744:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789776567.293149:0:11143:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776567.293173:0:11143:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000057f050f3/0x26940258de8efcf2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29af expref: 9 pid: 8384 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.293190:0:11143:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000057f050f3/0x26940258de8efcf2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29af expref: 9 pid: 8384 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.293231:0:11143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057f050f3/0x26940258de8efcf2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29af expref: 9 pid: 8384 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.293251:0:11143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789776567.293255:0:11143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789776567.293262:0:11143:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008688fcc9/0x26940258de8efd07 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.293273:0:11143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008688fcc9/0x26940258de8efd07 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.293315:0:11143:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776567.293376:0:11143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9de7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0795fb8a-e14a-4768-806c-f332ad101de7+8:2356:x1876716462095744:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 256us (4526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776567.293385:0:11143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 71 00010000:00010000:3.0:1789776567.293989:0:8384:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008688fcc9/0x26940258de8efd07 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776567.294001:0:8384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008688fcc9/0x26940258de8efd07 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776567.294027:0:8384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008688fcc9/0x26940258de8efd07 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776567.294036:0:8384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008688fcc9/0x26940258de8efd07 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776567.294044:0:8384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008688fcc9/0x26940258de8efd07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776567.294051:0:8384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681678a00 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:3.0:1789776567.294056:0:8384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008688fcc9/0x26940258de8efd07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776567.294076:0:8384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008688fcc9/0x26940258de8efd07 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776567.294093:0:8384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008688fcc9/0x26940258de8efd07 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776567.294102:0:8384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008688fcc9/0x26940258de8efd07 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776567.294180:0:8384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9de4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0795fb8a-e14a-4768-806c-f332ad101de7+7:2356:x1876716462095616:12345-192.168.202.6@tcp:1:lhsmtool_posix.0 Request processed in 15811us (15926us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776567.294188:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 57 00000040:00080000:1.0:1789776567.296980:0:12381:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789776567.296992:0:12381:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789776567.297066:0:12381:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1789776567.297071:0:12381:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789776567.302765:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776567.302805:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462096000 00000100:00100000:1.0:1789776567.302815:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462096000 00000100:00100000:1.0:1789776567.302878:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 186 00000100:00100000:1.0:1789776567.302887:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+17:11496:x1876716462096000:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789776567.302977:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8efd0e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776567.302994:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8efd0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776567.303005:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8efd0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776567.303239:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8efd15 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776567.303253:0:8177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08200/0x26940258de8efcd6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c299a expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776567.303261:0:8177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8efd15 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776567.303298:0:8177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08200/0x26940258de8efcd6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c299a expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776567.303314:0:8177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08200/0x26940258de8efcd6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c299a expref: 18 pid: 5811 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776567.303331:0:8177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86880cd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8177:1876716471528320:192.168.202.6@tcp:104: 00000100:00100000:1.0:1789776567.303421:0:8177:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c868939b540 going to sleep for 11 seconds 00000100:00100000:2.0:1789776567.309648:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776567.309767:0:8177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86880cd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8177:1876716471528320:192.168.202.6@tcp:104: 00010000:00010000:3.0:1789776567.309792:0:8177:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8efd15 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776567.312599:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462096128 00000100:00100000:0.0:1789776567.312613:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462096128 00010000:00010000:1.0:1789776567.312721:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08200/0x26940258de8efcd6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c299a expref: 19 pid: 5811 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776567.312788:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 72 00000100:00100000:1.0:1789776567.312799:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0795fb8a-e14a-4768-806c-f332ad101de7+19:2356:x1876716462096128:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776567.312814:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776567.312821:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08200/0x26940258de8efcd6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c299a expref: 19 pid: 5811 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776567.312835:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08200/0x26940258de8efcd6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c299a expref: 19 pid: 5811 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776567.312856:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08200/0x26940258de8efcd6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c299a expref: 19 pid: 5811 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776567.312870:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c86a08df300) 00010000:00010000:1.0:1789776567.312875:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8efd15 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776567.312884:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8efd15 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776567.312890:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8efd15 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776567.312924:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776567.312993:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0795fb8a-e14a-4768-806c-f332ad101de7+18:2356:x1876716462096128:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 196us (3354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776567.313000:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 72 00010000:00010000:3.0:1789776567.313258:0:8177:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8efd15 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776567.313267:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8efd15 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789776567.313473:0:8177:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1789776567.313765:0:8177:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1789776567.313815:0:8177:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1789776567.313916:0:8177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf767480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8177:1876716471528448:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789776567.314005:0:8177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776567.314044:0:8177:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86893c3600 going to sleep for 11 seconds 00000100:00100000:1.0:1789776567.314355:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471528448 00000100:00100000:1.0:1789776567.314366:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471528448 00000100:00100000:1.0:1789776567.314411:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789776567.314419:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8177:x1876716471528448:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789776567.314502:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8177:x1876716471528448:12345-0@lo:1000:mdt00_003.0 Request processed in 84us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776567.314509:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789776567.314709:0:8177:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1789776567.314716:0:8177:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c86ba6f1880, transno 4294967315 00000100:00100000:0.0:1789776567.314737:0:8177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf767480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8177:1876716471528448:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1789776567.315293:0:8177:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1789776567.315357:0:8177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a0b58a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8177:1876716471528576:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789776567.315397:0:8177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776567.315418:0:8177:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86aa4a4780 going to sleep for 11 seconds 00000100:00100000:1.0:1789776567.320503:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471528576 00000100:00100000:1.0:1789776567.320519:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471528576 00000100:00100000:1.0:1789776567.320584:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789776567.320593:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a0b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8177:x1876716471528576:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789776567.320889:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a0b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8177:x1876716471528576:12345-0@lo:1000:mdt00_003.0 Request processed in 296us (5490us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1789776567.320897:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789776567.320969:0:8177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a0b58a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8177:1876716471528576:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1789776567.321022:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8efd15 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776567.321033:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8efd15 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776567.321039:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8efd15 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776567.321047:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5cbc00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776567.321051:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8efd15 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776567.321059:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8efd15 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776567.321089:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c86a08df300) 00010000:00010000:1.0:1789776567.321092:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789776567.321098:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8efd15 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776567.321104:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8efd15 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776567.321138:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8efc51 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776567.321145:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8efc51 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776567.321151:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8efc51 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776567.321155:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b08a00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776567.321157:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8efc51 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776567.321163:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8efc51 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776567.321170:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c86a08dfd00) 00010000:00010000:1.0:1789776567.321173:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789776567.321176:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8efc51 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776567.321181:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8efc51 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776567.321240:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8efd1c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776567.321254:0:8177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8efc6d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c297e expref: 21 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776567.321262:0:8177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8efd1c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776567.321295:0:8177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8efc6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c297e expref: 21 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776567.321309:0:8177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8efc6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c297e expref: 21 pid: 5812 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776567.321321:0:8177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86880cf100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8177:1876716471528704:192.168.202.6@tcp:104: 00000100:00100000:1.0:1789776567.321397:0:8177:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c868939b540 going to sleep for 11 seconds 00000100:00100000:1.0:1789776567.359836:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776567.359878:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462096256 00000100:00100000:1.0:1789776567.359888:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462096256 00010000:00010000:1.0:1789776567.359931:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8efc6d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c297e expref: 22 pid: 5812 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776567.359981:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 73 00000100:00100000:1.0:1789776567.359992:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86880cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0795fb8a-e14a-4768-806c-f332ad101de7+22:2356:x1876716462096256:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776567.360008:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776567.360015:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8efc6d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c297e expref: 22 pid: 5812 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776567.360018:0:8177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86880cf100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8177:1876716471528704:192.168.202.6@tcp:104: 00010000:00010000:1.0:1789776567.360041:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8efc6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c297e expref: 22 pid: 5812 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776567.364021:0:8177:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8efd1c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776567.366883:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775200/0x26940258de8efc6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c297e expref: 22 pid: 5812 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776567.366907:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c86a08dfd00) 00010000:00010000:1.0:1789776567.366912:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8efd1c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776567.366923:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8efd1c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776567.366932:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8efd1c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776567.367015:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776567.367097:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86880cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0795fb8a-e14a-4768-806c-f332ad101de7+21:2356:x1876716462096256:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 7104us (7269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776567.367106:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 73 00010000:00010000:2.0:1789776567.368349:0:8177:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8efd1c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.368362:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8efd1c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.368378:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8efd1c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.368384:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8efd1c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.368391:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8efd1c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.368397:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5cb600 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776567.368401:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8efd1c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.368408:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8efd1c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.368492:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c86a08dfd00) 00010000:00010000:2.0:1789776567.368496:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776567.368513:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8efd1c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.368520:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8efd1c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.368535:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8efd0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.368541:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8efd0e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.368546:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8efd0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.368552:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5ca400 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776567.368675:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8efd0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.368683:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8efd0e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.368692:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c86a08dfd00) 00010000:00010000:2.0:1789776567.368695:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789776567.368698:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8efd0e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.368703:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8efd0e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776567.369020:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+20:11496:x1876716462096000:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 66129us (66261us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1789776567.369030:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 186 00000020:00080000:2.0:1789776567.369045:0:8177:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789776567.369753:0:11658:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789776567.369765:0:11658:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1789776567.372386:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776567.372421:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462096512 00000100:00100000:3.0:1789776567.372432:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462096512 00000100:00100000:3.0:1789776567.372479:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 50 00000100:00100000:3.0:1789776567.372487:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa27c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+20:11496:x1876716462096512:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 00000040:00080000:0.0:1789776567.373396:0:11658:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1789776567.373409:0:11658:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000004:00080000:2.0:1789776567.374692:0:5814:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789776567.374815:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:2.0:1789776567.374886:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775a00/0x26940258de8efd23 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.374902:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775a00/0x26940258de8efd23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.374914:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775a00/0x26940258de8efd23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.374923:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775a00/0x26940258de8efd23 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.374929:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775a00/0x26940258de8efd23 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.374935:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775a00/0x26940258de8efd23 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.374967:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789776567.375071:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa27c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+22:11496:x1876716462096512:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 Request processed in 2580us (2690us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1789776567.375080:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 50 00000020:00080000:2.0:1789776567.375086:0:5814:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789776567.375149:0:8421:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776567.375155:0:8421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775a00/0x26940258de8efd23 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.375163:0:8421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8686775a00 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:2.0:1789776567.375166:0:8421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775a00/0x26940258de8efd23 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.375181:0:8421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775a00/0x26940258de8efd23 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.375194:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c86881a7b00) 00010000:00010000:2.0:1789776567.375197:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789776567.375201:0:8421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775a00/0x26940258de8efd23 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.375207:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775a00/0x26940258de8efd23 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776567.375246:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776567.375248:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776567.375250:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776568.215438:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776569.122990:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776569.123029:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776569.123058:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776569.123081:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776569.123109:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776569.123138:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462096896 00000100:00100000:3.0:1789776569.123149:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462096896 00000100:00100000:3.0:1789776569.124115:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462097024 00000100:00100000:3.0:1789776569.124125:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462097024 00000100:00100000:3.0:1789776569.124171:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 89 00000100:00100000:3.0:1789776569.124182:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0795fb8a-e14a-4768-806c-f332ad101de7+7:2354:x1876716462096896:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1789776569.124284:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0795fb8a-e14a-4768-806c-f332ad101de7+7:2354:x1876716462096896:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 104us (1253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776569.124293:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 89 00000100:00100000:3.0:1789776569.124314:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 90 00000100:00100000:3.0:1789776569.124322:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0795fb8a-e14a-4768-806c-f332ad101de7+5:2354:x1876716462097024:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1789776569.124360:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0795fb8a-e14a-4768-806c-f332ad101de7+5:2354:x1876716462097024:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 39us (1251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776569.124367:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 90 00000100:00100000:3.0:1789776569.124391:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462097152 00000100:00100000:3.0:1789776569.124394:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462097152 00000100:00100000:3.0:1789776569.124423:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462096768 00000100:00100000:3.0:1789776569.124426:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462096768 00000100:00100000:3.0:1789776569.124445:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 154 00000100:00100000:3.0:1789776569.124452:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d27fff26-e747-430b-8151-cc0e7e6df617+5:2354:x1876716462097152:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1789776569.124484:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d27fff26-e747-430b-8151-cc0e7e6df617+5:2354:x1876716462097152:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 32us (1425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776569.124491:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 154 00000100:00100000:3.0:1789776569.124505:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 155 00000100:00100000:3.0:1789776569.124515:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+22:2354:x1876716462096768:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1789776569.124547:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+22:2354:x1876716462096768:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 35us (1466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776569.124555:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 155 00000100:00100000:0.0:1789776569.126884:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462096640 00000100:00100000:0.0:1789776569.126901:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462096640 00000100:00100000:0.0:1789776569.126985:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 293 00000100:00100000:0.0:1789776569.126995:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa596850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:2354:x1876716462096640:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1789776569.127074:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa596850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:2354:x1876716462096640:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 80us (4172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776569.127082:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 293 00000100:00080000:2.0:1789776569.128203:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789776569.128247:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789776569.128251:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789776569.239348:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789776569.328263:0:12432:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789776569.328273:0:12432:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789776569.328312:0:12432:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1789776569.328316:0:12432:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789776569.495956:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776569.496023:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462097408 00000100:00100000:0.0:1789776569.496033:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462097408 00000100:00100000:0.0:1789776569.496095:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 187 00000100:00100000:0.0:1789776569.496104:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86880cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+22:11514:x1876716462097408:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1789776569.496125:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776569.496230:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09e00/0x26940258de8efd2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c29b6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776569.496481:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08000/0x26940258de8efd31 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776569.496499:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08000/0x26940258de8efd31 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776569.496512:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08000/0x26940258de8efd31 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776569.496524:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1789776569.496894:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09e00/0x26940258de8efd2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29b6 expref: 25 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776569.496911:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08000/0x26940258de8efd31 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29b6 expref: 24 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776569.496920:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:0.0:1789776569.496923:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789776569.496926:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86b9b08000, rc 0) 00000100:00100000:0.0:1789776569.496996:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86880cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+24:11514:x1876716462097408:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 892us (1061us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1789776569.497003:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 187 00000100:00100000:2.0:1789776569.501858:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776569.501893:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462097536 00000100:00100000:3.0:1789776569.501905:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462097536 00000100:00100000:3.0:1789776569.501976:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 188 00000100:00100000:3.0:1789776569.501986:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+24:11514:x1876716462097536:12345-192.168.202.6@tcp:34:lfs.0 00010000:00010000:3.0:1789776569.502066:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efd3f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.502100:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efd3f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.502129:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efd3f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.502193:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efd46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.502202:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efd46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.502209:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efd46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.502876:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8efd4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.502887:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8efd4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.502894:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8efd4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789776569.502950:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8efd4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.502964:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efd3f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.502971:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efd3f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.502979:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efd3f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.502994:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681678a00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776569.502998:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efd3f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.503005:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efd3f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.503019:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:3.0:1789776569.503022:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776569.503027:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efd3f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.503033:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efd3f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.503044:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efd46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.503050:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efd46 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.503056:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efd46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.503060:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681679c00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776569.503063:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efd46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.503069:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efd46 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.503099:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c8682cbea00) 00010000:00010000:3.0:1789776569.503102:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776569.503106:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efd46 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.503112:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efd46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.503128:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8efd4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.503318:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8efd4d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.503325:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8efd4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.503330:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681679400 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776569.503333:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8efd4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.503338:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8efd4d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.503355:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c8682cbe500) 00010000:00010000:3.0:1789776569.503357:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776569.503360:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8efd4d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.503365:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8efd4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776569.503513:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+24:11514:x1876716462097536:12345-192.168.202.6@tcp:34:lfs.0 Request processed in 1525us (1660us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776569.503524:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 188 00000100:00100000:1.0:1789776569.593714:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776569.593896:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462097792 00000100:00100000:3.0:1789776569.593910:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462097792 00000100:00100000:3.0:1789776569.593986:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 189 00000100:00100000:3.0:1789776569.593998:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86880cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+24:11517:x1876716462097792:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1789776569.594020:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776569.594041:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8efd54 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c29bd expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.594114:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efd5b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.594128:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efd5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.594139:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efd5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.594153:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efd62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.594159:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efd62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.594165:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efd62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.594524:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8efd69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.594534:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8efd69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.594542:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8efd69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776569.594554:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789776569.594660:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efd5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.594667:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efd5b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.594674:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efd5b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.594679:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681679c00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776569.594685:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efd5b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.594692:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efd5b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.594706:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:3.0:1789776569.594709:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776569.594714:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efd5b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.594730:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efd5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.594746:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efd62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.594751:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efd62 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.594757:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efd62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.594761:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681678a00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776569.594764:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efd62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.594770:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efd62 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.594777:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c8682cbe500) 00010000:00010000:3.0:1789776569.594779:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776569.594782:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efd62 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.595170:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efd62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.595209:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8efd54 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29bd expref: 27 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.595306:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8efd69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29bd expref: 26 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.595320:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c8682cbea00) 00010000:00010000:3.0:1789776569.595322:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789776569.595324:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8681679200, rc 0) 00000100:00100000:3.0:1789776569.595422:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86880cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+26:11517:x1876716462097792:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 1426us (1720us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1789776569.595431:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 189 00000100:00100000:0.0:1789776569.602417:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776569.602526:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462097920 00000100:00100000:2.0:1789776569.602538:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462097920 00000100:00100000:2.0:1789776569.603048:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 190 00000100:00100000:2.0:1789776569.603060:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a0b59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+26:11517:x1876716462097920:12345-192.168.202.6@tcp:54:lfs.0 00010000:00010000:2.0:1789776569.603142:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efd77 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776569.603160:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efd77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776569.603172:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efd77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776569.605378:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efd77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776569.605398:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efd77 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776569.605406:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efd77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776569.605413:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8686775c00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776569.605418:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efd77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776569.605427:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efd77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776569.605447:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c8682cbea00) 00010000:00010000:2.0:1789776569.605450:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789776569.605456:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efd77 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776569.605463:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8efd77 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776569.606873:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a0b59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+26:11517:x1876716462097920:12345-192.168.202.6@tcp:54:lfs.0 Request processed in 3800us (4450us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776569.606888:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 190 00000100:00100000:1.0:1789776569.614327:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776569.614495:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462098176 00000100:00100000:3.0:1789776569.614507:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462098176 00000100:00100000:3.0:1789776569.614611:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 51 00000100:00100000:3.0:1789776569.614835:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8689395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+26:11517:x1876716462098176:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:3.0:1789776569.615102:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8689395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+27:11517:x1876716462098176:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 479us (785us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1789776569.615110:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 51 00000100:00100000:1.0:1789776569.693430:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776569.693532:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462098432 00000100:00100000:3.0:1789776569.693544:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462098432 00000100:00100000:3.0:1789776569.693617:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 191 00000100:00100000:3.0:1789776569.693627:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8689394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+27:11043:x1876716462098432:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:3.0:1789776569.693653:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776569.693677:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8efd7e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c29c4 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.693813:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efd85 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.693829:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8efd69 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29bd expref: 28 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.693852:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efd85 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.693889:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8efd69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29bd expref: 28 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.693904:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8efd69 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29bd expref: 28 pid: 5812 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776569.693919:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7a8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1876716471528832:192.168.202.6@tcp:104: 00000100:00100000:3.0:1789776569.694324:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c868939b300 going to sleep for 11 seconds 00000100:00100000:0.0:1789776569.700520:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776569.700735:0:11143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462098560 00000100:00100000:2.0:1789776569.700747:0:11143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462098560 00010000:00010000:2.0:1789776569.700794:0:11143:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8efd69 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29bd expref: 29 pid: 5812 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776569.700859:0:11143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 74 00000100:00100000:2.0:1789776569.700869:0:11143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a0b5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0795fb8a-e14a-4768-806c-f332ad101de7+29:2356:x1876716462098560:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789776569.700887:0:11143:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776569.700894:0:11143:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8efd69 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29bd expref: 29 pid: 5812 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776569.700907:0:11143:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8efd69 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29bd expref: 29 pid: 5812 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776569.700939:0:11143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c8682cbea00) 00010000:00010000:2.0:1789776569.700944:0:11143:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efd85 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776569.700955:0:11143:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efd85 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776569.700962:0:11143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efd85 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776569.700983:0:11143:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776569.701044:0:11143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a0b5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0795fb8a-e14a-4768-806c-f332ad101de7+29:2356:x1876716462098560:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 176us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776569.701051:0:11143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 74 00010000:00010000:3.0:1789776569.701405:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8efd69 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29bd expref: 28 pid: 5812 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776569.701423:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7a8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1876716471528832:192.168.202.6@tcp:104: 00010000:00010000:3.0:1789776569.701445:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efd85 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.701455:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efd85 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.701461:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efd85 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776569.701480:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789776569.701658:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8efd7e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29c4 expref: 29 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.701686:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efd85 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29c4 expref: 28 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.701694:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c8682cbea00) 00010000:00010000:3.0:1789776569.701697:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789776569.701699:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8681678a00, rc 0) 00000100:00100000:3.0:1789776569.701728:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8689394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+28:11043:x1876716462098432:12345-192.168.202.6@tcp:101:bash.0 Request processed in 8103us (8311us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1789776569.701735:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 191 00000100:00100000:0.0:1789776569.706714:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776569.706953:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462098816 00000100:00100000:3.0:1789776569.706964:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462098816 00000100:00100000:3.0:1789776569.707024:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 192 00000100:00100000:3.0:1789776569.707035:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a0b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+28:11043:x1876716462098816:12345-192.168.202.6@tcp:36:bash.0 00010000:00010000:3.0:1789776569.707720:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efd93 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.707740:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efd93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.707751:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efd93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789776569.707987:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1789776569.708023:0:5813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005f1e7329 reply state 000000006bff5ac8 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efd93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776569.708051:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1789776569.708125:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1789776569.708274:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a0b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+32:11043:x1876716462098816:12345-192.168.202.6@tcp:36:bash.0 Request processed in 1238us (1572us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1789776569.708282:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 192 00000020:00080000:2.0:1789776569.708287:0:5813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1789776569.711296:0:3260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efd93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.711314:0:3260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efd93 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.711342:0:3260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efd93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.711348:0:3260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681679c00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776569.711353:0:3260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efd93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.711362:0:3260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efd93 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.711452:0:3260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c8682cbea00) 00010000:00010000:3.0:1789776569.711457:0:3260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776569.711462:0:3260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efd93 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.711469:0:3260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efd93 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776569.714590:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776569.714693:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462098944 00000100:00100000:3.0:1789776569.714705:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462098944 00000100:00100000:3.0:1789776569.714777:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 193 00000100:00100000:3.0:1789776569.714789:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a0b59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+31:11043:x1876716462098944:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:3.0:1789776569.714818:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776569.714843:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8efd9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c29cb expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.714919:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8efd9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29cb expref: 32 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.714965:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8efd9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29cb expref: 32 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.714989:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c8682cbea00) 00010000:00010000:3.0:1789776569.714992:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789776569.714996:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8681679400, rc 0) 00000100:00100000:3.0:1789776569.715064:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a0b59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+32:11043:x1876716462098944:12345-192.168.202.6@tcp:101:bash.0 Request processed in 276us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776569.715071:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 193 00000100:00100000:0.0:1789776569.720814:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776569.720950:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462099072 00000100:00100000:3.0:1789776569.720962:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462099072 00000100:00100000:3.0:1789776569.721027:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 58 00000100:00100000:3.0:1789776569.721038:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a0b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0795fb8a-e14a-4768-806c-f332ad101de7+7:11043:x1876716462099072:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:3.0:1789776569.721057:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776569.721081:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4e151d0/0x26940258de8efda1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c29d2 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789776569.721111:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aadd2b6, atime: 0x6aadd2b4, ctime: 0x6aadd2b6, blocks: 0xb 00010000:00010000:3.0:1789776569.721136:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=322s v=(0 0) 00010000:00010000:3.0:1789776569.721141:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789776569.721150:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4e151d0/0x26940258de8efda1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29d2 expref: 8 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.721169:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d4e151d0/0x26940258de8efda1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29d2 expref: 8 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.721202:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8681679c00, rc 0) 00000100:00100000:3.0:1789776569.721311:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a0b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0795fb8a-e14a-4768-806c-f332ad101de7+8:11043:x1876716462099072:12345-192.168.202.6@tcp:101:bash.0 Request processed in 274us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776569.721319:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 58 00000100:00100000:0.0:1789776569.731630:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776569.732000:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462099200 00000100:00100000:2.0:1789776569.732011:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462099200 00002000:00010000:2.0:1789776569.732059:0:6665:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1789776569.732064:0:6665:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c86a0b58000 with x1876716462099200 ext(0->18446744073709551615) 00002000:00010000:2.0:1789776569.732077:0:6665:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c86a0b58000. 00000100:00100000:2.0:1789776569.732166:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5 00000100:00100000:2.0:1789776569.732177:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a0b58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0795fb8a-e14a-4768-806c-f332ad101de7+8:2357:x1876716462099200:12345-192.168.202.6@tcp:10:bash.0 00002000:00010000:2.0:1789776569.732544:0:6665:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1789776569.732548:0:6665:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789776566 -> 1789776570 00002000:00010000:2.0:1789776569.732551:0:6665:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1789776564 -> 1789776564 00002000:00010000:2.0:1789776569.732553:0:6665:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789776566 -> 1789776570 00002000:00010000:2.0:1789776569.732555:0:6665:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1789776569.732609:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a0b58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0795fb8a-e14a-4768-806c-f332ad101de7+9:2357:x1876716462099200:12345-192.168.202.6@tcp:10:bash.0 Request processed in 434us (991us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1789776569.732616:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5 00002000:00010000:2.0:1789776569.732620:0:6665:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1789776569.732623:0:6665:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c86a0b58000 with x1876716462099200 ext(0->18446744073709551615) 00002000:00010000:2.0:1789776569.732627:0:6665:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c86a0b58000. 00000100:00100000:2.0:1789776569.824560:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776569.824701:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462099328 00000100:00100000:0.0:1789776569.824713:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462099328 00000100:00100000:0.0:1789776569.824814:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 194 00000100:00100000:0.0:1789776569.824825:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+32:11531:x1876716462099328:12345-192.168.202.6@tcp:34:lfs.0 00010000:00010000:0.0:1789776569.824898:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8efda8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776569.824916:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8efda8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776569.824927:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8efda8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776569.824960:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8efdaf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776569.824968:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8efdaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776569.824975:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8efdaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776569.825269:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8efdb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776569.825278:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8efdb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776569.825286:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8efdb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789776569.825327:0:8177:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8efdb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776569.825339:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8efda8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776569.825344:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8efda8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776569.825351:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8efda8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776569.825357:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b08e00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776569.825361:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8efda8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776569.825387:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8efda8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776569.825400:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:0.0:1789776569.825403:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776569.825408:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8efda8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776569.825413:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8efda8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776569.825427:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8efdaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776569.825433:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8efdaf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776569.825439:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8efdaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776569.825444:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b09a00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776569.825446:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8efdaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776569.825452:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8efdaf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776569.825459:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c86a08df900) 00010000:00010000:0.0:1789776569.825461:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776569.825464:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8efdaf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776569.825480:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09a00/0x26940258de8efdaf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776569.825497:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8efdb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776569.825503:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8efdb6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776569.825508:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8efdb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776569.825513:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b09000 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776569.825516:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8efdb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776569.825523:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8efdb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776569.825530:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c8682cbea00) 00010000:00010000:0.0:1789776569.825532:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776569.825536:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8efdb6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776569.825541:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8efdb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776569.825624:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+32:11531:x1876716462099328:12345-192.168.202.6@tcp:34:lfs.0 Request processed in 800us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776569.825633:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 194 00000100:00100000:0.0:1789776569.900926:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776569.901409:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462099584 00000100:00100000:3.0:1789776569.901420:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462099584 00000100:00100000:3.0:1789776569.901536:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 195 00000100:00100000:3.0:1789776569.901546:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a0b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+32:11534:x1876716462099584:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1789776569.901568:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776569.901599:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8efdbd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c29d9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.901682:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8efdc4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.901698:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8efdc4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.901709:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8efdc4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.901725:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efdcb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.901733:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efdcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.901739:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efdcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.902063:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8efdd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.902074:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8efdd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.902082:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8efdd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776569.902091:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789776569.902182:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8efdc4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.902189:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8efdc4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.902196:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8efdc4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.902202:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681678800 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776569.902206:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8efdc4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.902245:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8efdc4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.902260:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:3.0:1789776569.902263:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776569.902268:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8efdc4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.905200:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8efdc4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.905261:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efdcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.905269:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efdcb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.905276:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efdcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.905563:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681678000 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776569.905569:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efdcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.905587:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efdcb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.905603:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c8682cbed00) 00010000:00010000:3.0:1789776569.905606:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776569.905611:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efdcb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.905617:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8efdcb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.905685:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8efdbd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29d9 expref: 35 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.905701:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8efdd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29d9 expref: 34 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.905726:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c8682cbea00) 00010000:00010000:3.0:1789776569.905729:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789776569.905731:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86829e0e00, rc 0) 00000100:00100000:3.0:1789776569.905817:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a0b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+34:11534:x1876716462099584:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 4272us (4901us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1789776569.905826:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 195 00000100:00100000:1.0:1789776569.914093:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776569.914575:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462099712 00000100:00100000:2.0:1789776569.914647:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462099712 00000100:00100000:2.0:1789776569.914768:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 196 00000100:00100000:2.0:1789776569.914780:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+34:11534:x1876716462099712:12345-192.168.202.6@tcp:54:lfs.0 00010000:00010000:2.0:1789776569.914868:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775800/0x26940258de8efde0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776569.914886:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efd85 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29c4 expref: 34 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776569.914896:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775800/0x26940258de8efde0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776569.914945:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efd85 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29c4 expref: 34 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776569.914959:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efd85 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29c4 expref: 34 pid: 5811 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776569.914975:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c8582a72d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1876716471528960:192.168.202.6@tcp:104: 00000100:00100000:2.0:1789776569.915089:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf30ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1789776569.917999:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c8582a72d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1876716471528960:192.168.202.6@tcp:104: 00010000:00010000:3.0:1789776569.918033:0:5813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775800/0x26940258de8efde0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776569.925891:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776569.926406:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462099968 00000100:00100000:2.0:1789776569.926419:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462099968 00000100:00100000:2.0:1789776569.926523:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 52 00000100:00100000:2.0:1789776569.926533:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bfeb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+35:5595:x1876716462099968:12345-192.168.202.6@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789776569.926918:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bfeb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+36:5595:x1876716462099968:12345-192.168.202.6@tcp:35:ldlm_bl.0 Request processed in 385us (1037us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1789776569.926926:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 52 00000100:00100000:0.0:1789776569.930594:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776569.930759:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462100096 00000100:00100000:1.0:1789776569.930769:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462100096 00010000:00010000:1.0:1789776569.930826:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efd85 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29c4 expref: 36 pid: 5811 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776569.930868:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 75 00000100:00100000:1.0:1789776569.930878:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c869880a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0795fb8a-e14a-4768-806c-f332ad101de7+36:2357:x1876716462100096:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776569.930894:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776569.930900:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efd85 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29c4 expref: 36 pid: 5811 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776569.930915:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efd85 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29c4 expref: 36 pid: 5811 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776569.930947:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efd85 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29c4 expref: 36 pid: 5811 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776569.930965:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c8682cbea00) 00010000:00010000:1.0:1789776569.930971:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775800/0x26940258de8efde0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776569.930981:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775800/0x26940258de8efde0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776569.930990:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775800/0x26940258de8efde0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776569.931042:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776569.931114:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c869880a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0795fb8a-e14a-4768-806c-f332ad101de7+35:2357:x1876716462100096:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 238us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776569.931122:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 75 00010000:00010000:3.0:1789776569.932265:0:5813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775800/0x26940258de8efde0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.932278:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775800/0x26940258de8efde0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.932309:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775800/0x26940258de8efde0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.932315:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775800/0x26940258de8efde0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.932323:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775800/0x26940258de8efde0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.932329:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8686775800 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776569.932333:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775800/0x26940258de8efde0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.932356:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775800/0x26940258de8efde0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.932378:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c8682cbea00) 00010000:00010000:3.0:1789776569.932382:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789776569.932386:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775800/0x26940258de8efde0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776569.932393:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775800/0x26940258de8efde0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776569.932458:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+34:11534:x1876716462099712:12345-192.168.202.6@tcp:54:lfs.0 Request processed in 17678us (18375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776569.932467:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 196 00000100:00100000:0.0:1789776569.936594:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776569.936684:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462100352 00000100:00100000:3.0:1789776569.936696:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462100352 00000100:00100000:3.0:1789776569.936760:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 53 00000100:00100000:3.0:1789776569.936770:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a0b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+34:11534:x1876716462100352:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:3.0:1789776569.937046:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a0b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+35:11534:x1876716462100352:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 276us (474us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1789776569.937053:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 53 00000100:00100000:0.0:1789776570.101366:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776570.101530:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462100608 00000100:00100000:1.0:1789776570.101540:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462100608 00000100:00100000:1.0:1789776570.101767:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 197 00000100:00100000:1.0:1789776570.101779:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a0b59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+35:11545:x1876716462100608:12345-192.168.202.6@tcp:101:cat.0 00010000:00010000:1.0:1789776570.101813:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776570.101834:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efde7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c29e0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.101915:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efdee lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.101938:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efdee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.101950:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efdee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.101967:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8efdf5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.101974:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8efdf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.101994:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8efdf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.102300:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8efdfc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.102309:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8efdfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.102316:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8efdfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776570.102325:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1789776570.102423:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efdee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.102431:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efdee lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.102437:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efdee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.102443:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5caa00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776570.102447:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efdee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.102455:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efdee lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.102468:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:1.0:1789776570.102470:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776570.102475:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efdee lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.102491:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efdee lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.102505:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8efdf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.102511:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8efdf5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.102516:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8efdf5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.102521:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5ca400 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776570.102524:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8efdf5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.102529:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8efdf5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.102536:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c8683789700) 00010000:00010000:1.0:1789776570.102539:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776570.102542:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8efdf5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.102547:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8efdf5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.102605:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efde7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29e0 expref: 38 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.102979:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8efdfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29e0 expref: 37 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.102994:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c8682cbea00) 00010000:00010000:1.0:1789776570.102997:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789776570.103000:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86bf5cb600, rc 0) 00000100:00100000:1.0:1789776570.103129:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a0b59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+37:11545:x1876716462100608:12345-192.168.202.6@tcp:101:cat.0 Request processed in 1352us (1772us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1789776570.103137:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 197 00000100:00100000:1.0:1789776570.108140:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776570.108494:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462100864 00000100:00100000:3.0:1789776570.108504:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462100864 00000100:00100000:2.0:1789776570.108791:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 54 00000100:00100000:2.0:1789776570.108804:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bfeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+37:11545:x1876716462100864:12345-192.168.202.6@tcp:35:cat.0 00000100:00100000:2.0:1789776570.109123:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bfeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+38:11545:x1876716462100864:12345-192.168.202.6@tcp:35:cat.0 Request processed in 321us (993us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1789776570.109130:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 54 00000100:00100000:0.0:1789776570.139910:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776570.140068:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462101120 00000100:00100000:1.0:1789776570.140080:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462101120 00000100:00100000:1.0:1789776570.140266:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 198 00000100:00100000:1.0:1789776570.140276:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a0b5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+38:11546:x1876716462101120:12345-192.168.202.6@tcp:36:rm.0 00010000:00010000:1.0:1789776570.140338:0:8177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789776570.140366:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8efdfc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29e0 expref: 38 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.140388:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8efdd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29d9 expref: 37 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.140400:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8efd9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29cb expref: 36 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.140410:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c8682cbea00) 00010000:00010000:1.0:1789776570.140421:0:8177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789776570.140444:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efe0a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.140477:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efe0a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.140487:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efe0a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.140503:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8efe11 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.140509:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8efe11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.140514:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8efe11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.141004:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efe18 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.141013:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efe18 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.141020:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efe18 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789776570.147200:0:8177:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:1.0:1789776570.147237:0:8177:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 322927019406ns, next at 323926995964ns, rc = 0 00010000:00010000:1.0:1789776570.147330:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8efe1f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.147349:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8efe1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.147373:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8efe1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.147382:0:8177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8efe1f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.147388:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8efe1f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.147394:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8efe1f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.147488:0:8177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789776570.147513:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efe18 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.147521:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efe18 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.147527:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efe18 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.147533:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5caa00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776570.147538:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efe18 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.147546:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efe18 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.147559:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c8683789a00) 00010000:00010000:1.0:1789776570.147563:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789776570.147575:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efe18 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.147596:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efe18 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.148066:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efe0a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.148076:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efe0a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.148083:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efe0a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.148089:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5ca600 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776570.148092:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efe0a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.148099:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efe0a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.148109:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:1.0:1789776570.148112:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776570.148115:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efe0a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.148121:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efe0a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789776570.148135:0:8177:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003f01f960 reply state 00000000f36d03b2 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8efe11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776570.148158:0:8177:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789776570.148290:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a0b5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+37:11546:x1876716462101120:12345-192.168.202.6@tcp:36:rm.0 Request processed in 8011us (8385us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1789776570.148300:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 198 00010000:00010000:0.0:1789776570.153411:0:3259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8efe11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776570.153432:0:3259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8efe11 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776570.153441:0:3259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8efe11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776570.153447:0:3259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5ca400 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776570.153451:0:3259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8efe11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776570.153458:0:3259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8efe11 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776570.153476:0:3259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c8683789700) 00010000:00010000:0.0:1789776570.153479:0:3259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776570.153483:0:3259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8efe11 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776570.153490:0:3259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8efe11 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.156539:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776570.156554:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8efe1f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.156565:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5cbc00 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:2.0:1789776570.156570:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8efe1f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.156590:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8efe1f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.156610:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c8683789a00) 00010000:00010000:2.0:1789776570.156620:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789776570.156625:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8efe1f lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.156631:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8efe1f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.156656:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776570.156658:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776570.156659:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776570.225702:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776570.225806:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462101376 00000100:00100000:3.0:1789776570.225817:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462101376 00000100:00100000:3.0:1789776570.226039:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 199 00000100:00100000:3.0:1789776570.226048:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a0b59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+36:11552:x1876716462101376:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:3.0:1789776570.226082:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776570.226103:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8efe26 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c29e7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.226212:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8efe2d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.226257:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8efe2d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.226267:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8efe2d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.226278:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8efe34 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.226282:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8efe34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.226286:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8efe34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789776570.226738:0:5812:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1789776570.226869:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8efe3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.226875:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8efe3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.226880:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8efe3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.227167:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8efe2d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.227175:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8efe2d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.227182:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8efe2d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.227188:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86829e0a00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776570.227192:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8efe2d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.227200:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8efe2d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.227213:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:3.0:1789776570.227243:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776570.227248:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8efe2d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.227253:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0a00/0x26940258de8efe2d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789776570.227273:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000071c456ac reply state 000000001b81ca03 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8efe34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776570.227283:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789776570.227314:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0400/0x26940258de8efe26 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29e7 expref: 39 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.227341:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8efe3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29e7 expref: 38 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.227347:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c8682cbe400) 00010000:00010000:3.0:1789776570.227350:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789776570.227352:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86829e0e00, rc 0) 00000100:00100000:3.0:1789776570.227473:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a0b59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+39:11552:x1876716462101376:12345-192.168.202.6@tcp:101:bash.0 Request processed in 1425us (1781us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1789776570.227481:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 199 00000100:00100000:3.0:1789776570.230714:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776570.232568:0:8384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462101504 00000100:00100000:0.0:1789776570.232603:0:8384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462101504 00000100:00100000:0.0:1789776570.232674:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 59 00000100:00100000:0.0:1789776570.232683:0:8384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0795fb8a-e14a-4768-806c-f332ad101de7+5:2356:x1876716462101504:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:0.0:1789776570.232700:0:8384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776570.232720:0:8384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b644bfcb/0x26940258de8efe49 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c29ee expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789776570.232745:0:8384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789776570.232765:0:8384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=323s v=(0 0) 00010000:00010000:0.0:1789776570.232769:0:8384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789776570.232779:0:8384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b644bfcb/0x26940258de8efe49 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29ee expref: 6 pid: 8384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776570.232808:0:8384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b644bfcb/0x26940258de8efe49 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29ee expref: 6 pid: 8384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776570.232822:0:8384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86b9b09c00, rc 0) 00000100:00100000:0.0:1789776570.232893:0:8384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0795fb8a-e14a-4768-806c-f332ad101de7+6:2356:x1876716462101504:12345-192.168.202.6@tcp:101:bash.0 Request processed in 210us (2188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776570.232900:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 59 00010000:00010000:2.0:1789776570.237772:0:3260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8efe34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.237890:0:3260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8efe34 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.237914:0:3260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8efe34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.237920:0:3260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86829e1200 already unused, calling callback (ffffffffc21c34f0) 00000100:00100000:3.0:1789776570.237921:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00010000:2.0:1789776570.237925:0:3260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8efe34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.237941:0:3260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8efe34 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.237957:0:3260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c8682cbed00) 00010000:00010000:2.0:1789776570.237960:0:3260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776570.237965:0:3260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8efe34 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.237972:0:3260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1200/0x26940258de8efe34 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776570.238053:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462101632 00000100:00100000:1.0:1789776570.238063:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462101632 00000100:00100000:1.0:1789776570.238111:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 60 00000100:00100000:1.0:1789776570.238122:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0795fb8a-e14a-4768-806c-f332ad101de7+6:11552:x1876716462101632:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:1.0:1789776570.238138:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776570.238155:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008dd26b38/0x26940258de8efe50 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c29f5 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.238180:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b644bfcb/0x26940258de8efe49 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29ee expref: 7 pid: 8384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.238186:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776570.238190:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776570.238193:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008dd26b38/0x26940258de8efe50 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29f5 expref: 7 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.238262:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b644bfcb/0x26940258de8efe49 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29ee expref: 7 pid: 8384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.238273:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b644bfcb/0x26940258de8efe49 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29ee expref: 7 pid: 8384 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776570.238294:0:6659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6659:1876716471529088:192.168.202.6@tcp:104: 00000100:00100000:1.0:1789776570.238366:0:6659:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c869868f000 going to sleep for 11 seconds 00000100:00100000:2.0:1789776570.241423:0:6659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6659:1876716471529088:192.168.202.6@tcp:104: 00010000:00010000:2.0:1789776570.241471:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008dd26b38/0x26940258de8efe50 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29f5 expref: 7 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.241494:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86bf5caa00, rc 0) 00000100:00100000:2.0:1789776570.241552:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0795fb8a-e14a-4768-806c-f332ad101de7+7:11552:x1876716462101632:12345-192.168.202.6@tcp:101:bash.0 Request processed in 3431us (3644us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776570.241561:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 60 00000100:00100000:3.0:1789776570.241802:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776570.243147:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462101760 00000100:00100000:1.0:1789776570.243159:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462101760 00010000:00010000:1.0:1789776570.243200:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b644bfcb/0x26940258de8efe49 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29ee expref: 7 pid: 8384 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776570.243250:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 76 00000100:00100000:1.0:1789776570.243259:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bff61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0795fb8a-e14a-4768-806c-f332ad101de7+7:2357:x1876716462101760:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776570.243274:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776570.243296:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b644bfcb/0x26940258de8efe49 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29ee expref: 7 pid: 8384 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.243310:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b644bfcb/0x26940258de8efe49 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29ee expref: 7 pid: 8384 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.243334:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b644bfcb/0x26940258de8efe49 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29ee expref: 7 pid: 8384 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.243351:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776570.243355:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776570.243364:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008dd26b38/0x26940258de8efe50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29f5 expref: 6 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.243462:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008dd26b38/0x26940258de8efe50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29f5 expref: 6 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.243502:0:5797:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008dd26b38/0x26940258de8efe50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29f5 expref: 6 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776570.243516:0:5797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6c8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5797:1876716471529216:192.168.202.6@tcp:105: 00000100:00100000:1.0:1789776570.243747:0:5797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c869868f000 going to sleep for 11 seconds 00000100:00100000:3.0:1789776570.248598:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776570.248722:0:5797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6c8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5797:1876716471529216:192.168.202.6@tcp:105: 00010000:00010000:1.0:1789776570.248759:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776570.248821:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bff61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0795fb8a-e14a-4768-806c-f332ad101de7+6:2357:x1876716462101760:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 5562us (7019us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776570.248833:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 76 00000100:00100000:0.0:1789776570.248973:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462102016 00000100:00100000:0.0:1789776570.248982:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462102016 00000100:00100000:0.0:1789776570.249035:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 55 00000100:00100000:0.0:1789776570.249044:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bff62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+38:11552:x1876716462102016:12345-192.168.202.6@tcp:35:bash.0 00000100:00100000:0.0:1789776570.249427:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bff62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+39:11552:x1876716462102016:12345-192.168.202.6@tcp:35:bash.0 Request processed in 383us (849us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1789776570.249450:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 55 00010000:00010000:3.0:1789776570.260432:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776570.426505:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776570.429389:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462102144 00000100:00100000:2.0:1789776570.429407:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462102144 00000100:00100000:2.0:1789776570.429512:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 200 00000100:00100000:2.0:1789776570.429523:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+39:11568:x1876716462102144:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1789776570.429549:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776570.429573:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8efe57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c29fc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.429649:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774a00/0x26940258de8efe5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.429664:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774a00/0x26940258de8efe5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.429676:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774a00/0x26940258de8efe5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776570.429712:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789776570.429716:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789776570.429735:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774a00/0x26940258de8efe5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.429761:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8efe57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29fc expref: 41 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.429781:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774a00/0x26940258de8efe5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29fc expref: 40 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.429803:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:2.0:1789776570.429806:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789776570.429810:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8686774a00, rc 0) 00000100:00100000:2.0:1789776570.429886:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+40:11568:x1876716462102144:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 364us (3391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776570.429900:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 200 00000100:00100000:2.0:1789776570.446556:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776570.446665:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462102400 00000100:00100000:1.0:1789776570.446676:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462102400 00000100:00100000:1.0:1789776570.446745:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 201 00000100:00100000:1.0:1789776570.446755:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+40:11568:x1876716462102400:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1789776570.446776:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776570.446813:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8efe65 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2a03 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.446915:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8efe6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.446938:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8efe6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.446965:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8efe6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776570.446977:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789776570.447114:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8efe65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a03 expref: 43 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.447134:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8efe6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a03 expref: 42 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.447143:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c8682cbe400) 00010000:00010000:1.0:1789776570.447146:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789776570.447150:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86bf5cae00, rc 0) 00000100:00100000:1.0:1789776570.447450:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+42:11568:x1876716462102400:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 695us (903us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1789776570.447458:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 201 00000100:00100000:3.0:1789776570.455327:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776570.457592:0:11143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462102528 00000100:00100000:2.0:1789776570.457608:0:11143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462102528 00000100:00100000:2.0:1789776570.457694:0:11143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 15 00000100:00100000:2.0:1789776570.457706:0:11143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0795fb8a-e14a-4768-806c-f332ad101de7+42:2357:x1876716462102528:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789776570.457722:0:11143:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776570.457749:0:11143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8efe6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a03 expref: 42 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.457771:0:11143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c8682cbe400) 00010000:00010000:2.0:1789776570.457776:0:11143:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776570.457855:0:11143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0795fb8a-e14a-4768-806c-f332ad101de7+41:2357:x1876716462102528:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 152us (2536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776570.457862:0:11143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 15 00000100:00100000:2.0:1789776570.462894:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776570.462996:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462102784 00000100:00100000:1.0:1789776570.463006:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462102784 00000100:00100000:1.0:1789776570.463068:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 202 00000100:00100000:1.0:1789776570.463079:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+41:11568:x1876716462102784:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1789776570.463102:0:8177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776570.463123:0:8177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8efe7a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2a0a expref: -99 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.463266:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8efe81 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.463302:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8efe81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.463312:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8efe81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776570.463323:0:8177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789776570.463452:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8efe7a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a0a expref: 44 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.463467:0:8177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8efe81 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a0a expref: 43 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.463473:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c8682cbe400) 00010000:00010000:1.0:1789776570.463476:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789776570.463478:0:8177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86bf5cb400, rc 0) 00000100:00100000:1.0:1789776570.463534:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+43:11568:x1876716462102784:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 458us (650us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1789776570.463538:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 202 00000100:00100000:3.0:1789776570.471519:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776570.471698:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462102912 00000100:00100000:2.0:1789776570.471710:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462102912 00000100:00100000:2.0:1789776570.471796:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 61 00000100:00100000:2.0:1789776570.471807:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0795fb8a-e14a-4768-806c-f332ad101de7+6:2356:x1876716462102912:12345-192.168.202.6@tcp:1:lfs.0 00010000:00010000:2.0:1789776570.471855:0:6662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004210e610/0x26940258de8efe8f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.471877:0:6662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008dd26b38/0x26940258de8efe50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29f5 expref: 6 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.471905:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776570.471910:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789776570.471915:0:6662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004210e610/0x26940258de8efe8f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.471965:0:6662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008dd26b38/0x26940258de8efe50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29f5 expref: 6 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.471982:0:6662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008dd26b38/0x26940258de8efe50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29f5 expref: 6 pid: 6659 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776570.471999:0:6662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c8582a70a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6662:1876716471529344:192.168.202.6@tcp:104: 00000100:00100000:2.0:1789776570.472106:0:6662:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf30e480 going to sleep for 11 seconds 00000100:00100000:2.0:1789776570.474620:0:6662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c8582a70a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6662:1876716471529344:192.168.202.6@tcp:104: 00010000:00010000:2.0:1789776570.474653:0:6662:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004210e610/0x26940258de8efe8f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776570.476437:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776570.476868:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462103040 00000100:00100000:2.0:1789776570.476878:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462103040 00002000:00100000:2.0:1789776570.476954:0:6667:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9c86bb4f3b80 x1876716462103040/t0(0) o4->0795fb8a-e14a-4768-806c-f332ad101de7@192.168.202.6@tcp:6/0 lens 504/0 e 0 to 0 dl 1789776581 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789776570.476966:0:6667:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c86bb4f3b80 with x1876716462103040 ext(0->8) 00010000:00010000:2.0:1789776570.476975:0:6667:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008dd26b38/0x26940258de8efe50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29f5 expref: 7 pid: 6659 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.477012:0:6667:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008dd26b38/0x26940258de8efe50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29f5 expref: 7 pid: 6659 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789776570.477022:0:6667:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9c86bb4f3b80 00000100:00100000:2.0:1789776570.477062:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 3 00000100:00100000:2.0:1789776570.477072:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0795fb8a-e14a-4768-806c-f332ad101de7+7:2357:x1876716462103040:12345-192.168.202.6@tcp:4:lfs.0 00000100:00100000:2.0:1789776570.477891:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0795fb8a-e14a-4768-806c-f332ad101de7+9:2357:x1876716462103040:12345-192.168.202.6@tcp:4:lfs.0 Request processed in 817us (1459us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789776570.477976:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 3 00002000:00100000:2.0:1789776570.477985:0:6667:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9c86bb4f3b80 x1876716462103040/t4294967308(0) o4->0795fb8a-e14a-4768-806c-f332ad101de7@192.168.202.6@tcp:6/0 lens 504/448 e 0 to 0 dl 1789776581 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789776570.477994:0:6667:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c86bb4f3b80 with x1876716462103040 ext(0->8) 00010000:00010000:2.0:1789776570.478002:0:6667:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008dd26b38/0x26940258de8efe50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29f5 expref: 9 pid: 6659 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.478014:0:6667:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008dd26b38/0x26940258de8efe50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29f5 expref: 9 pid: 6659 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789776570.478021:0:6667:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9c86bb4f3b80 00000100:00100000:3.0:1789776570.480975:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776570.481064:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462103168 00000100:00100000:1.0:1789776570.481074:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462103168 00010000:00010000:1.0:1789776570.481115:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008dd26b38/0x26940258de8efe50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29f5 expref: 9 pid: 6659 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776570.481158:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 77 00000100:00100000:1.0:1789776570.481169:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0795fb8a-e14a-4768-806c-f332ad101de7+9:2356:x1876716462103168:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776570.481185:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789776570.481255:0:5796:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789776570.481259:0:5796:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789776570 00002000:00010000:1.0:1789776570.481262:0:5796:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789776571 00002000:00010000:1.0:1789776570.481264:0:5796:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789776570 00010000:00010000:1.0:1789776570.481271:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008dd26b38/0x26940258de8efe50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29f5 expref: 9 pid: 6659 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.481285:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008dd26b38/0x26940258de8efe50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29f5 expref: 9 pid: 6659 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.481307:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008dd26b38/0x26940258de8efe50 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29f5 expref: 9 pid: 6659 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.481324:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789776570.481328:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789776570.481334:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004210e610/0x26940258de8efe8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.481344:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004210e610/0x26940258de8efe8f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.481484:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776570.481534:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0795fb8a-e14a-4768-806c-f332ad101de7+8:2356:x1876716462103168:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 367us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776570.481542:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 77 00010000:00010000:2.0:1789776570.481622:0:6662:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004210e610/0x26940258de8efe8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.481631:0:6662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004210e610/0x26940258de8efe8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.481668:0:6662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004210e610/0x26940258de8efe8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.481676:0:6662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004210e610/0x26940258de8efe8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.481684:0:6662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004210e610/0x26940258de8efe8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.481691:0:6662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8686775000 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:2.0:1789776570.481695:0:6662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004210e610/0x26940258de8efe8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.481704:0:6662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004210e610/0x26940258de8efe8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.481715:0:6662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004210e610/0x26940258de8efe8f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.481722:0:6662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004210e610/0x26940258de8efe8f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776570.481766:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0795fb8a-e14a-4768-806c-f332ad101de7+7:2356:x1876716462102912:12345-192.168.202.6@tcp:1:lfs.0 Request processed in 9961us (10259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776570.481774:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 61 00000100:00100000:3.0:1789776570.485270:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776570.485376:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462103424 00000100:00100000:2.0:1789776570.485386:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462103424 00000100:00100000:2.0:1789776570.485486:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 56 00000100:00100000:2.0:1789776570.485498:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa27d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+43:11568:x1876716462103424:12345-192.168.202.6@tcp:35:lfs.0 00000004:00010000:2.0:1789776570.485565:0:5814:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8efe81 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a0a expref: 43 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789776570.485849:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:2.0:1789776570.485897:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1789776570.486334:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1789776570.486390:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775e00/0x26940258de8efe96 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.486405:0:5814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8efe3b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29e7 expref: 47 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.486415:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775e00/0x26940258de8efe96 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.486451:0:5814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8efe3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29e7 expref: 47 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.486465:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8efe3b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29e7 expref: 47 pid: 5812 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776570.486478:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c8582a70a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5814:1876716471529472:192.168.202.6@tcp:104: 00000100:00100000:2.0:1789776570.486564:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf30e480 going to sleep for 11 seconds 00000100:00100000:3.0:1789776570.489586:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776570.489684:0:11142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462103552 00000100:00100000:1.0:1789776570.489694:0:11142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462103552 00010000:00010000:1.0:1789776570.489732:0:11142:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8efe3b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29e7 expref: 48 pid: 5812 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776570.489794:0:11142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 78 00000100:00100000:1.0:1789776570.489805:0:11142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf34df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0795fb8a-e14a-4768-806c-f332ad101de7+48:2356:x1876716462103552:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776570.489821:0:11142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776570.489828:0:11142:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8efe3b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29e7 expref: 48 pid: 5812 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.489843:0:11142:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8efe3b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29e7 expref: 48 pid: 5812 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.489866:0:11142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c8682cbe400) 00010000:00010000:1.0:1789776570.489872:0:11142:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775e00/0x26940258de8efe96 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.489881:0:11142:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775e00/0x26940258de8efe96 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.489888:0:11142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775e00/0x26940258de8efe96 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.489983:0:11142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776570.490084:0:11142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf34df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0795fb8a-e14a-4768-806c-f332ad101de7+48:2356:x1876716462103552:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 281us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776570.490104:0:11142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 78 00010000:00010000:2.0:1789776570.490385:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e0e00/0x26940258de8efe3b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29e7 expref: 47 pid: 5812 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776570.490417:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c8582a70a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5814:1876716471529472:192.168.202.6@tcp:104: 00010000:00010000:2.0:1789776570.490440:0:5814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775e00/0x26940258de8efe96 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.490449:0:5814:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775e00/0x26940258de8efe96 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.490457:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775e00/0x26940258de8efe96 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789776570.490578:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1789776570.490783:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1789776570.490888:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c8582a70a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5814:1876716471529600:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789776570.491468:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776570.491531:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf30e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776570.491790:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471529600 00000100:00100000:1.0:1789776570.491797:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471529600 00000100:00100000:1.0:1789776570.491893:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789776570.491979:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5814:x1876716471529600:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789776570.492076:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5814:x1876716471529600:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 174us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776570.492084:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789776570.492823:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c8582a70a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5814:1876716471529600:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789776570.493659:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1789776570.493742:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6c8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5814:1876716471529728:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789776570.493798:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776570.493823:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8691c629c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776570.494021:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471529728 00000100:00100000:3.0:1789776570.494028:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471529728 00000100:00100000:3.0:1789776570.494062:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789776570.494071:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9de7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5814:x1876716471529728:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789776570.494303:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9de7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5814:x1876716471529728:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 232us (505us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789776570.494321:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789776570.494600:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6c8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5814:1876716471529728:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789776570.494669:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1789776570.494715:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775e00/0x26940258de8efe96 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.494727:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775e00/0x26940258de8efe96 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.494735:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775e00/0x26940258de8efe96 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.494742:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8686775e00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776570.494747:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775e00/0x26940258de8efe96 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.494756:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775e00/0x26940258de8efe96 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.494771:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c8682cbe400) 00010000:00010000:1.0:1789776570.494774:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789776570.494788:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775e00/0x26940258de8efe96 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.494795:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775e00/0x26940258de8efe96 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789776570.495171:0:5814:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789776570.495896:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000100:00080000:2.0:1789776570.496029:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1789776570.496071:0:5814:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 323275853749ns, next at 324275851143ns, rc = 0 00000001:00080000:1.0:1789776570.496080:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1789776570.496126:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c8682cbe400) 00010000:00010000:1.0:1789776570.496130:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789776570.496140:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8efe81 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a0a expref: 51 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776570.496277:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa27d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+50:11568:x1876716462103424:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 10781us (11017us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1789776570.496286:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 56 00000020:00080000:1.0:1789776570.496291:0:5814:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789776570.501809:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776570.501899:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462103680 00000100:00100000:1.0:1789776570.501919:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462103680 00000100:00100000:1.0:1789776570.501992:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 203 00000100:00100000:1.0:1789776570.502002:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf34d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+50:11568:x1876716462103680:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1789776570.502026:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776570.502051:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8efe9d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2a11 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.502117:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8efe9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a11 expref: 51 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.502154:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8efe9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a11 expref: 51 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.502175:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c8683789800) 00010000:00010000:1.0:1789776570.502178:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789776570.502181:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86bf5cb400, rc 0) 00000100:00100000:1.0:1789776570.502274:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf34d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+51:11568:x1876716462103680:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 273us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776570.502282:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 203 00000100:00100000:3.0:1789776570.506200:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776570.506510:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462103936 00000100:00100000:2.0:1789776570.506521:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462103936 00000100:00100000:2.0:1789776570.506583:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 57 00000100:00100000:2.0:1789776570.506593:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf34ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+51:11568:x1876716462103936:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:2.0:1789776570.507014:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf34ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+52:11568:x1876716462103936:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 421us (823us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1789776570.507023:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 57 00000100:00100000:0.0:1789776570.590454:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776570.590557:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462104064 00000100:00100000:1.0:1789776570.590567:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462104064 00000100:00100000:1.0:1789776570.590632:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 204 00000100:00100000:1.0:1789776570.590641:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a0b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+52:11578:x1876716462104064:12345-192.168.202.6@tcp:34:lfs.0 00010000:00010000:1.0:1789776570.590716:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efea4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.590732:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efea4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.590743:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efea4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.590757:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8efeab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.590764:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8efeab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.590976:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8efeab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.591069:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efeb2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.591078:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efeb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.591086:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efeb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789776570.591127:0:8177:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efeb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.591140:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efea4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.591147:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efea4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.591154:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efea4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.591159:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5caa00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776570.591163:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efea4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.591170:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efea4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.591182:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:1.0:1789776570.591192:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776570.591197:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efea4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.591203:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efea4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.591303:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8efeab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.591311:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8efeab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.591317:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8efeab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.591322:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5cae00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776570.591324:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8efeab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.591330:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8efeab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.591336:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c8683789600) 00010000:00010000:1.0:1789776570.591338:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776570.591341:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8efeab lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.591346:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8efeab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.591362:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efeb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.591372:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efeb2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.591377:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efeb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.591382:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5ca600 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776570.591384:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efeb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.591389:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efeb2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.591395:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c8683789800) 00010000:00010000:1.0:1789776570.591397:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776570.591400:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efeb2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.591405:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efeb2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776570.591476:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a0b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+52:11578:x1876716462104064:12345-192.168.202.6@tcp:34:lfs.0 Request processed in 836us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776570.591484:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 204 00000100:00100000:3.0:1789776570.664421:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776570.667777:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462104320 00000100:00100000:1.0:1789776570.667805:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462104320 00000100:00100000:1.0:1789776570.667891:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 205 00000100:00100000:1.0:1789776570.667902:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf34c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+52:11581:x1876716462104320:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1789776570.667939:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776570.667976:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efeb9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2a18 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.668060:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8efec0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.668075:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8efec0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.668086:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8efec0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.668102:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efec7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.668109:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efec7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.668115:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efec7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.668271:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8efece lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.668280:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8efece lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.668288:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8efece lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776570.668297:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789776570.668392:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8efec0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.668411:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8efec0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.668417:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8efec0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.668423:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5cae00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776570.668428:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8efec0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.668437:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8efec0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.668450:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:1.0:1789776570.668452:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776570.668456:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8efec0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.668462:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cae00/0x26940258de8efec0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.668477:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efec7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.668483:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efec7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.668489:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efec7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.668493:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5caa00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776570.668502:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efec7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.668509:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efec7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.668516:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c8683789600) 00010000:00010000:1.0:1789776570.668519:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776570.668521:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efec7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.668527:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efec7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.668569:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efeb9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a18 expref: 55 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.668582:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8efece lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a18 expref: 54 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.668589:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c8683789800) 00010000:00010000:1.0:1789776570.668591:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789776570.668594:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86bf5ca400, rc 0) 00000100:00100000:1.0:1789776570.668670:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf34c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+54:11581:x1876716462104320:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 769us (4259us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1789776570.668679:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 205 00000100:00100000:3.0:1789776570.673671:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776570.673771:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462104448 00000100:00100000:2.0:1789776570.673782:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462104448 00000100:00100000:2.0:1789776570.673863:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 206 00000100:00100000:2.0:1789776570.673873:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf34ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+54:11581:x1876716462104448:12345-192.168.202.6@tcp:54:lfs.0 00010000:00010000:2.0:1789776570.673955:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8efedc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.673973:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8efedc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.673985:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8efedc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.674012:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8efedc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.674019:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8efedc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.674025:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8efedc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.674031:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8686775000 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776570.674035:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8efedc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.674043:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8efedc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.674055:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c8683789800) 00010000:00010000:2.0:1789776570.674058:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789776570.674062:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8efedc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776570.674068:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8efedc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776570.674165:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf34ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+54:11581:x1876716462104448:12345-192.168.202.6@tcp:54:lfs.0 Request processed in 292us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776570.674173:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 206 00000100:00100000:0.0:1789776570.680654:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776570.680743:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462104704 00000100:00100000:1.0:1789776570.680753:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462104704 00000100:00100000:1.0:1789776570.680808:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 58 00000100:00100000:1.0:1789776570.680817:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a0b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+54:11581:x1876716462104704:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:1.0:1789776570.681092:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a0b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+55:11581:x1876716462104704:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 275us (450us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1789776570.681100:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 58 00000100:00100000:0.0:1789776570.773320:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789776570.773370:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9deed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471529856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789776570.773630:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776570.773743:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471529856 00000100:00100000:2.0:1789776570.773752:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471529856 00000100:00100000:2.0:1789776570.773842:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789776570.773852:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9def480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3273:x1876716471529856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789776570.773891:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789776570.773960:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9def480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3273:x1876716471529856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776570.773967:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789776570.774025:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9deed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471529856:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789776570.775991:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789776570.818757:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776570.818912:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462104960 00000100:00100000:1.0:1789776570.818933:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462104960 00000100:00100000:1.0:1789776570.818997:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 207 00000100:00100000:1.0:1789776570.819007:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af8c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+55:11591:x1876716462104960:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:1.0:1789776570.819035:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776570.819039:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789776570.819069:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774a00/0x26940258de8efe5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29fc expref: 55 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.819091:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:1.0:1789776570.819096:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789776570.819119:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efee3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2a1f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.819264:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efeea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.819278:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efeea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.819288:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efeea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776570.819299:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789776570.819451:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efee3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a1f expref: 57 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.819476:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efeea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a1f expref: 56 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.819484:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c8683789800) 00010000:00010000:1.0:1789776570.819487:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789776570.819489:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86bf5caa00, rc 0) 00000100:00100000:1.0:1789776570.819549:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af8c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+56:11591:x1876716462104960:12345-192.168.202.6@tcp:101:bash.0 Request processed in 544us (805us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1789776570.819556:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 207 00000001:00080000:1.0:1789776570.836998:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:1.0:1789776570.837019:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:1.0:1789776570.837026:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:3.0:1789776570.840593:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776570.840774:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462105216 00000100:00100000:2.0:1789776570.840788:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462105216 00000100:00100000:2.0:1789776570.840855:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 208 00000100:00100000:2.0:1789776570.840865:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af8caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+56:11591:x1876716462105216:12345-192.168.202.6@tcp:36:bash.0 00010000:00010000:3.0:1789776570.843322:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789776570.843712:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5caa00/0x26940258de8efeea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a1f expref: 56 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.844862:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8efece lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a18 expref: 55 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.844876:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c8683789800) 00010000:00010000:3.0:1789776570.844882:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789776570.845491:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efef8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.845509:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efef8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.845519:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efef8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789776570.845711:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:3.0:1789776570.845743:0:5813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005f1f9956 reply state 000000008eae110d transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efef8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776570.845770:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789776570.845889:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af8caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+57:11591:x1876716462105216:12345-192.168.202.6@tcp:36:bash.0 Request processed in 5023us (5303us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1789776570.846168:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 208 00000020:00080000:3.0:1789776570.846175:0:5813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789776570.849462:0:3259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efef8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776570.849481:0:3259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efef8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776570.849489:0:3259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efef8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776570.849495:0:3259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681678a00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776570.849500:0:3259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efef8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776570.849508:0:3259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efef8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776570.849526:0:3259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c8683789800) 00010000:00010000:0.0:1789776570.849529:0:3259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776570.849534:0:3259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efef8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776570.849541:0:3259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8efef8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776570.851449:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776570.851589:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462105344 00000100:00100000:1.0:1789776570.851600:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462105344 00000100:00100000:1.0:1789776570.851766:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 209 00000100:00100000:1.0:1789776570.851778:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af8c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+56:11591:x1876716462105344:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:1.0:1789776570.851814:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776570.851835:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efeff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2a26 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.851950:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8eff06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.851966:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8eff06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.851978:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8eff06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776570.852022:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789776570.852027:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789776570.852047:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8eff06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.852077:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8efeff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a26 expref: 58 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.852095:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8eff06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a26 expref: 57 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.852104:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c8683789800) 00010000:00010000:1.0:1789776570.852107:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789776570.852111:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86bf5cbc00, rc 0) 00000100:00100000:1.0:1789776570.852184:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af8c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+57:11591:x1876716462105344:12345-192.168.202.6@tcp:101:bash.0 Request processed in 408us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776570.852191:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 209 00000100:00100000:0.0:1789776570.860479:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776570.860819:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462105600 00000100:00100000:2.0:1789776570.860830:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462105600 00000100:00100000:2.0:1789776570.860909:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 59 00000100:00100000:2.0:1789776570.860929:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9dec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+57:11591:x1876716462105600:12345-192.168.202.6@tcp:35:bash.0 00000100:00100000:2.0:1789776570.861346:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9dec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+58:11591:x1876716462105600:12345-192.168.202.6@tcp:35:bash.0 Request processed in 426us (877us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1789776570.861355:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 59 00000100:00100000:2.0:1789776570.979004:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776570.979245:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462105728 00000100:00100000:1.0:1789776570.979257:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462105728 00000100:00100000:1.0:1789776570.979318:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 210 00000100:00100000:1.0:1789776570.979329:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+58:11597:x1876716462105728:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1789776570.979353:0:8177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776570.979373:0:8177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8eff0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2a2d expref: -99 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.979441:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca800/0x26940258de8eff14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.979467:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca800/0x26940258de8eff14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.979478:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca800/0x26940258de8eff14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776570.979516:0:8177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1789776570.979520:0:8177:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789776570.979537:0:8177:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca800/0x26940258de8eff14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.979564:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8eff0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a2d expref: 60 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.979596:0:8177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca800/0x26940258de8eff14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a2d expref: 59 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776570.979605:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:1.0:1789776570.979608:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789776570.979613:0:8177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86bf5ca800, rc 0) 00000100:00100000:1.0:1789776570.979680:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+59:11597:x1876716462105728:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 353us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776570.979687:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 210 00000100:00100000:0.0:1789776570.986080:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776570.986565:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462105856 00000100:00100000:3.0:1789776570.986587:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462105856 00000100:00100000:3.0:1789776570.986653:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 211 00000100:00100000:3.0:1789776570.986664:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9dedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+59:11597:x1876716462105856:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1789776570.986686:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776570.986708:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8eff1b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2a34 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.986772:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8eff22 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.986789:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8eff22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.986801:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8eff22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.986816:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8eff29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.986823:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8eff29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.986850:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8eff29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.986967:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8eff30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.986976:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8eff30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.986983:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8eff30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776570.987028:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789776570.987045:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789776570.987068:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8eff30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.987080:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8eff30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.987089:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8eff22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.987110:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8eff22 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.987116:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8eff22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.987122:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681679200 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776570.987127:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8eff22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.987144:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8eff22 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.987156:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:3.0:1789776570.987159:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776570.987164:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8eff22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.987169:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8eff22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.987184:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8eff29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.987189:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8eff29 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.987195:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8eff29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.987200:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681678000 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776570.987203:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8eff29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.987209:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8eff29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.987281:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c8682cbe400) 00010000:00010000:3.0:1789776570.987284:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776570.987288:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8eff29 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.987303:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8eff29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.987337:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8eff1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a34 expref: 61 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.987351:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8eff30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a34 expref: 60 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776570.987358:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c8683789800) 00010000:00010000:3.0:1789776570.987360:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789776570.987363:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8681678800, rc 0) 00000100:00100000:3.0:1789776570.987795:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9dedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+60:11597:x1876716462105856:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 1131us (1722us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776570.987803:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 211 00000100:00100000:3.0:1789776571.000605:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776571.000695:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776571.000762:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462106112 00000100:00100000:1.0:1789776571.000773:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462106112 00000100:00100000:1.0:1789776571.000864:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 212 00000100:00100000:1.0:1789776571.000875:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af8cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+60:11597:x1876716462106112:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1789776571.000897:0:8177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776571.000945:0:8177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8eff37 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2a3b expref: -99 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.001071:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8eff3e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.001087:0:8177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8eff06 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a26 expref: 61 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.001109:0:8177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8eff30 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a34 expref: 61 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.001118:0:8177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8eff3e lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.001157:0:8177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8eff30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a34 expref: 61 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.001171:0:8177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8eff30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a34 expref: 61 pid: 5812 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776571.001183:0:8177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c8689395180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8177:1876716471529984:192.168.202.6@tcp:104: 00000100:00100000:2.0:1789776571.001309:0:11143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462106240 00000100:00100000:2.0:1789776571.001314:0:11143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462106240 00010000:00010000:2.0:1789776571.001337:0:11143:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8eff30 lrc: 6/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a34 expref: 62 pid: 5812 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776571.001361:0:11143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 79 00000100:00100000:2.0:1789776571.001369:0:11143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af8ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0795fb8a-e14a-4768-806c-f332ad101de7+62:2357:x1876716462106240:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789776571.001379:0:11143:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776571.001384:0:11143:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8eff30 lrc: 6/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a34 expref: 62 pid: 5812 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.001397:0:11143:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8eff30 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a34 expref: 62 pid: 5812 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.001415:0:11143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c8683789800) 00010000:00010000:2.0:1789776571.001420:0:11143:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8eff3e lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.001426:0:11143:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8eff3e lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.001432:0:11143:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789776571.002965:0:8177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8eff06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a26 expref: 62 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.002985:0:8177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8eff06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a26 expref: 62 pid: 5811 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776571.002999:0:8177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bfeb3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8177:1876716471530112:192.168.202.6@tcp:104: 00000100:00100000:2.0:1789776571.003110:0:11143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af8ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0795fb8a-e14a-4768-806c-f332ad101de7+62:2357:x1876716462106240:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 1733us (2406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776571.003121:0:11143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 79 00000100:00080000:2.0:1789776571.003186:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789776571.007850:0:8177:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8682c5fe40 going to sleep for 11 seconds 00010000:00010000:1.0:1789776571.007899:0:8177:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.6@tcp) returned -22 from blocking AST (req@00000000e1314224 x1876716471529984) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8eff30 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a34 expref: 61 pid: 5812 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.007931:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8eff30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a34 expref: 61 pid: 5812 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776571.007952:0:8177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c8689395180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8177:1876716471529984:192.168.202.6@tcp:104: 00000100:00100000:1.0:1789776571.012107:0:8177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bfeb3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8177:1876716471530112:192.168.202.6@tcp:104: 00010000:00010000:1.0:1789776571.012142:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c8683789800) 00010000:00010000:1.0:1789776571.012148:0:8177:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8eff3e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.012159:0:8177:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8eff3e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.012169:0:8177:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8eff3e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776571.014872:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776571.015536:0:11144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462106368 00000100:00100000:2.0:1789776571.015547:0:11144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462106368 00010000:00010000:2.0:1789776571.015618:0:11144:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8eff06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a26 expref: 61 pid: 5811 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776571.015681:0:11144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 80 00000100:00100000:2.0:1789776571.015691:0:11144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9ded180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0795fb8a-e14a-4768-806c-f332ad101de7+61:2356:x1876716462106368:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789776571.015707:0:11144:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776571.015714:0:11144:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8eff06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a26 expref: 61 pid: 5811 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.015728:0:11144:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8eff06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a26 expref: 61 pid: 5811 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.015752:0:11144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cbc00/0x26940258de8eff06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a26 expref: 61 pid: 5811 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.015769:0:11144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c8683789800) 00010000:00010000:2.0:1789776571.015774:0:11144:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8eff3e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.015783:0:11144:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8eff3e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.015791:0:11144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8eff3e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.015829:0:11144:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776571.015888:0:11144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9ded180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0795fb8a-e14a-4768-806c-f332ad101de7+60:2356:x1876716462106368:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 198us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776571.015895:0:11144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 80 00010000:00010000:0.0:1789776571.016947:0:8177:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8eff3e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.016959:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8eff3e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776571.016980:0:8177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789776571.017401:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8eff37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a3b expref: 61 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.017422:0:8177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8eff3e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a3b expref: 60 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.017430:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c8683789800) 00010000:00010000:0.0:1789776571.017433:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789776571.017437:0:8177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86bf5cb200, rc 0) 00000100:00100000:0.0:1789776571.017503:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af8cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+60:11597:x1876716462106112:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 16629us (16909us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1789776571.017511:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 212 00000100:00100000:0.0:1789776571.024110:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776571.024319:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462106624 00000100:00100000:1.0:1789776571.024330:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462106624 00000100:00100000:1.0:1789776571.024397:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 16 00000100:00100000:1.0:1789776571.024408:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c869880a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0795fb8a-e14a-4768-806c-f332ad101de7+60:11597:x1876716462106624:12345-192.168.202.6@tcp:103:lfs.0 00010000:00010000:1.0:1789776571.024426:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776571.024452:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8efe9d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a11 expref: 60 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.024494:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c8683789800) 00010000:00010000:1.0:1789776571.024500:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776571.024558:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c869880a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0795fb8a-e14a-4768-806c-f332ad101de7+59:11597:x1876716462106624:12345-192.168.202.6@tcp:103:lfs.0 Request processed in 151us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776571.024565:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 16 00000100:00100000:2.0:1789776571.028554:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776571.028840:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462106752 00000100:00100000:1.0:1789776571.028851:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462106752 00000100:00100000:1.0:1789776571.028912:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 213 00000100:00100000:1.0:1789776571.028932:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+59:11597:x1876716462106752:12345-192.168.202.6@tcp:58:lfs.0 00010000:00010000:1.0:1789776571.029310:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8eff4c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.029331:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8eff4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.029343:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8eff4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789776571.029526:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1789776571.029698:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+59:11597:x1876716462106752:12345-192.168.202.6@tcp:58:lfs.0 Request processed in 775us (1151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776571.029706:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 213 00000100:00100000:3.0:1789776571.033910:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776571.034076:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462106880 00000100:00100000:2.0:1789776571.034087:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462106880 00000100:00100000:2.0:1789776571.034160:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 214 00000100:00100000:2.0:1789776571.034171:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af8c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+59:11597:x1876716462106880:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1789776571.034192:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776571.034505:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8eff53 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2a42 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.034568:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8eff4c lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.034592:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8eff53 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a42 expref: 60 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.034612:0:5813:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8eff4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.034626:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8eff53 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a42 expref: 60 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.034639:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c8683789800) 00010000:00010000:2.0:1789776571.034642:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789776571.034646:0:5813:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8eff53 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a42 expref: 60 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.034654:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8686775c00, rc 0) 00000100:00100000:2.0:1789776571.034716:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af8c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+60:11597:x1876716462106880:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 547us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776571.034723:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 214 00010000:00010000:2.0:1789776571.289637:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789776571.476525:0:11658:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789776571.476537:0:11658:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789776571.476576:0:11658:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1789776571.476584:0:11658:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789776571.476728:0:11658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb54e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11658:1876716471530240:192.168.202.6@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789776571.476955:0:11658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf30e480 going to sleep for 11 seconds 00000100:00100000:2.0:1789776571.484260:0:11658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb54e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11658:1876716471530240:192.168.202.6@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789776571.488501:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776571.493155:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462107008 00000100:00100000:3.0:1789776571.493171:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462107008 00000100:00100000:3.0:1789776571.493328:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 215 00000100:00100000:3.0:1789776571.493340:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+60:11598:x1876716462107008:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789776571.493407:0:5812:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789776571.493592:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+60:11598:x1876716462107008:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 Request processed in 254us (5101us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776571.493600:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 215 00000100:00100000:3.0:1789776571.501465:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776571.501730:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462107136 00000100:00100000:0.0:1789776571.501742:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462107136 00000100:00100000:0.0:1789776571.501816:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 216 00000100:00100000:0.0:1789776571.501827:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af8ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+60:11598:x1876716462107136:12345-192.168.202.6@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789776571.502053:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09600/0x26940258de8eff5a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.502075:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09600/0x26940258de8eff5a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.502089:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09600/0x26940258de8eff5a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.502135:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08200/0x26940258de8eff61 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.502144:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08200/0x26940258de8eff61 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.502152:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08200/0x26940258de8eff61 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.502193:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8eff68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.502203:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8eff68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.502210:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8eff68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776571.502288:0:8177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789776571.502292:0:8177:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789776571.502307:0:8177:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8eff68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.502318:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09600/0x26940258de8eff5a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.502333:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09600/0x26940258de8eff5a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.502341:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09600/0x26940258de8eff5a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.502349:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b09600 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776571.502353:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09600/0x26940258de8eff5a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.502362:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09600/0x26940258de8eff5a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.502375:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c8683789100) 00010000:00010000:0.0:1789776571.502378:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776571.502384:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09600/0x26940258de8eff5a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.502391:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09600/0x26940258de8eff5a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.502406:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08200/0x26940258de8eff61 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.502413:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08200/0x26940258de8eff61 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.502419:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08200/0x26940258de8eff61 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.502425:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b08200 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776571.502435:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08200/0x26940258de8eff61 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.502443:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08200/0x26940258de8eff61 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.502452:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9c86a08dfa00) 00010000:00010000:0.0:1789776571.502455:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776571.502458:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08200/0x26940258de8eff61 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.502464:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08200/0x26940258de8eff61 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.502479:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8eff68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.502487:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8eff68 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.502493:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8eff68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.502499:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b08a00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776571.502502:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8eff68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.502508:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8eff68 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.502516:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c8683789800) 00010000:00010000:0.0:1789776571.502518:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776571.502530:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8eff68 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.502537:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8eff68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776571.503122:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af8ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+60:11598:x1876716462107136:12345-192.168.202.6@tcp:34:lhsmtool_posix.0 Request processed in 1292us (1664us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776571.503133:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 216 00000100:00100000:0.0:1789776571.512862:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776571.513392:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462107392 00000100:00100000:1.0:1789776571.513405:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462107392 00000100:00100000:1.0:1789776571.513477:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 217 00000100:00100000:1.0:1789776571.513489:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9deed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+60:11598:x1876716462107392:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789776571.513512:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776571.513553:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8eff6f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2a49 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.513861:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8eff76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.513877:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8eff76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.513891:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8eff76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776571.513980:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789776571.514358:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8eff76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.514368:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8eff76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.514375:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8eff76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.514381:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5ca600 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776571.514385:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8eff76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.514393:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8eff76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.514406:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c8683789800) 00010000:00010000:1.0:1789776571.514410:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789776571.514414:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8eff76 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.514435:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8eff76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.514484:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8eff6f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a49 expref: 62 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.514494:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c8683789100) 00010000:00010000:1.0:1789776571.514497:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789776571.514501:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8eff6f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a49 expref: 62 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.514510:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86bf5cb400, rc 0) 00000100:00100000:1.0:1789776571.514770:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9deed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+61:11598:x1876716462107392:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 1282us (1921us total) trans 4294967503 rc 301/301 00000100:00100000:1.0:1789776571.514778:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 217 00000100:00100000:0.0:1789776571.518694:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776571.518774:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462107520 00000100:00100000:2.0:1789776571.518785:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462107520 00000100:00100000:2.0:1789776571.518847:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 218 00000100:00100000:2.0:1789776571.518857:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba3bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+61:11598:x1876716462107520:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789776571.518903:0:5813:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789776571.519030:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba3bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+61:11598:x1876716462107520:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 Request processed in 174us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776571.519038:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 218 00000100:00100000:2.0:1789776571.523712:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776571.524132:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462107776 00000100:00100000:3.0:1789776571.524143:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462107776 00000100:00100000:3.0:1789776571.524303:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 219 00000100:00100000:3.0:1789776571.524316:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb54e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+61:11598:x1876716462107776:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789776571.524340:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776571.524344:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789776571.524377:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca800/0x26940258de8eff14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a2d expref: 61 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.524399:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:3.0:1789776571.524403:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789776571.524417:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8eff84 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2a50 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789776571.525038:0:5812:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:3.0:1789776571.525317:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8eff8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.525331:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8eff8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.525341:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8eff8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.525397:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8eff84 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a50 expref: 63 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.525413:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8eff8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a50 expref: 62 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.525437:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c8682cbe400) 00010000:00010000:3.0:1789776571.525440:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789776571.525443:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8681679400, rc 0) 00000100:00100000:3.0:1789776571.525851:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb54e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+62:11598:x1876716462107776:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 1536us (2147us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1789776571.525860:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 219 00000100:00100000:1.0:1789776571.530721:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776571.530881:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462108032 00000100:00100000:2.0:1789776571.530901:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462108032 00000100:00100000:2.0:1789776571.530978:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 220 00000100:00100000:2.0:1789776571.530989:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bfeb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+62:11598:x1876716462108032:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789776571.531054:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776571.531092:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679400/0x26940258de8eff8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a50 expref: 62 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.531116:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c8682cbe400) 00010000:00010000:2.0:1789776571.531143:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789776571.531177:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775a00/0x26940258de8eff99 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.531192:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775a00/0x26940258de8eff99 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.531203:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775a00/0x26940258de8eff99 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.531301:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8effa0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x910bad4a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.531310:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8effa0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x910bad4a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.531317:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8effa0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x910bad4a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.531388:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775a00/0x26940258de8eff99 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.531395:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775a00/0x26940258de8eff99 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.531402:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775a00/0x26940258de8eff99 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.531799:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8686775a00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776571.531804:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775a00/0x26940258de8eff99 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.531812:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775a00/0x26940258de8eff99 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.531831:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:2.0:1789776571.531833:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776571.531838:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775a00/0x26940258de8eff99 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.531844:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775a00/0x26940258de8eff99 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.531855:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8effa0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x910bad4a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.531860:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8effa0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x910bad4a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.531866:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8effa0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x910bad4a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.531870:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8686774200 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776571.531873:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8effa0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x910bad4a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.531878:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8effa0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x910bad4a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.531884:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x910bad4a (ffff9c86881a7000) 00010000:00010000:2.0:1789776571.531886:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776571.532023:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8effa0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x910bad4a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.532032:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8effa0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x910bad4a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776571.532199:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bfeb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+61:11598:x1876716462108032:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 Request processed in 1209us (1486us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789776571.532207:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 220 00000100:00100000:0.0:1789776571.535470:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776571.535588:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462108160 00000100:00100000:1.0:1789776571.535598:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462108160 00000100:00100000:1.0:1789776571.535669:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 221 00000100:00100000:1.0:1789776571.535680:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba3bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+61:11598:x1876716462108160:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789776571.535701:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776571.535726:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8effa7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2a57 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.535764:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8effae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.535797:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8effae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.535810:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8effae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.536039:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8effa7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a57 expref: 63 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.536061:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8effae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a57 expref: 62 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.536070:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c8683789600) 00010000:00010000:1.0:1789776571.536073:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789776571.536077:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86bf5ca600, rc 0) 00000100:00100000:1.0:1789776571.536148:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba3bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+62:11598:x1876716462108160:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 469us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776571.536619:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 221 00000100:00100000:0.0:1789776571.541123:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776571.541311:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462108416 00000100:00100000:1.0:1789776571.541323:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462108416 00000100:00100000:1.0:1789776571.541382:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 222 00000100:00100000:1.0:1789776571.541393:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba3bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+62:11598:x1876716462108416:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789776571.541487:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8effb5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.541507:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8effb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.541539:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8effb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789776571.541845:0:8177:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:1.0:1789776571.541856:0:8177:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 324321639321ns, next at 325321636885ns, rc = 0 00000004:00010000:1.0:1789776571.542204:0:8177:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000036c0757a reply state 0000000030ce1ef3 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8effb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776571.542254:0:8177:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789776571.542357:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba3bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+64:11598:x1876716462108416:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 Request processed in 965us (1242us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1789776571.542365:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 222 00010000:00010000:3.0:1789776571.546648:0:3260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8effb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.546666:0:3260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8effb5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.546674:0:3260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8effb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.546681:0:3260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5ca400 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776571.546686:0:3260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8effb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.546694:0:3260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8effb5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.546713:0:3260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c8683789600) 00010000:00010000:3.0:1789776571.546716:0:3260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789776571.546721:0:3260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8effb5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.546727:0:3260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca400/0x26940258de8effb5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776571.547035:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776571.547842:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462108544 00000100:00100000:1.0:1789776571.547854:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462108544 00000100:00100000:1.0:1789776571.548019:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 223 00000100:00100000:1.0:1789776571.548031:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba3be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+63:11598:x1876716462108544:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789776571.548062:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776571.548087:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8effbc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2a5e expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.548167:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8effbc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a5e expref: 64 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.548184:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8effbc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a5e expref: 64 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.548205:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c8683789600) 00010000:00010000:1.0:1789776571.548256:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789776571.548261:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86bf5cb400, rc 0) 00000100:00100000:1.0:1789776571.548340:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba3be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+64:11598:x1876716462108544:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 311us (1311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776571.548347:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 223 00000100:00100000:2.0:1789776571.552073:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776571.552189:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462108672 00000100:00100000:0.0:1789776571.552202:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462108672 00000100:00100000:0.0:1789776571.552351:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 62 00000100:00100000:0.0:1789776571.552363:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb54ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+9:2356:x1876716462108672:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789776571.552729:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb54ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+10:2356:x1876716462108672:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 Request processed in 367us (666us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1789776571.552737:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 62 00000100:00080000:2.0:1789776571.553453:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789776571.556500:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776571.556688:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462108928 00000100:00100000:2.0:1789776571.556699:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462108928 00000100:00100000:2.0:1789776571.556798:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 60 00000100:00100000:2.0:1789776571.556809:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba3bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+64:11598:x1876716462108928:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789776571.557103:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba3bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+65:11598:x1876716462108928:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 Request processed in 294us (612us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1789776571.557111:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 60 00000100:00100000:3.0:1789776571.559740:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776571.559860:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462109184 00000100:00100000:2.0:1789776571.559947:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462109184 00000100:00100000:2.0:1789776571.560067:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 224 00000100:00100000:2.0:1789776571.560079:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af8ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+65:11598:x1876716462109184:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789776571.560244:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af8ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+65:11598:x1876716462109184:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 138us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776571.560253:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 224 00000100:00100000:0.0:1789776571.565363:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776571.565457:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462109312 00000100:00100000:3.0:1789776571.565469:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462109312 00000100:00100000:3.0:1789776571.565533:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 225 00000100:00100000:3.0:1789776571.565544:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+65:11598:x1876716462109312:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789776571.565569:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776571.565605:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8effc3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2a65 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.565704:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8effca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.565719:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8effca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.565731:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8effca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776571.565771:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789776571.565790:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8effca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.565819:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678000/0x26940258de8effc3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a65 expref: 67 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.565839:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8effca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a65 expref: 66 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.565848:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c8683789600) 00010000:00010000:3.0:1789776571.565859:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789776571.565864:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8681678a00, rc 0) 00000100:00100000:3.0:1789776571.566075:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+66:11598:x1876716462109312:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 532us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776571.566082:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 225 00000100:00100000:0.0:1789776571.571348:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776571.571474:0:8384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462109440 00000100:00100000:3.0:1789776571.571487:0:8384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462109440 00000100:00100000:3.0:1789776571.571604:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 63 00000100:00100000:3.0:1789776571.571616:0:8384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba7d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0795fb8a-e14a-4768-806c-f332ad101de7+10:2355:x1876716462109440:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789776571.571639:0:8384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776571.571663:0:8384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007f2812b/0x26940258de8effd1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2a6c expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789776571.571691:0:8384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aadd2bc, blocks: 0x1 00010000:00010000:3.0:1789776571.571714:0:8384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=324s v=(0 0) 00010000:00010000:3.0:1789776571.571719:0:8384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789776571.571729:0:8384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007f2812b/0x26940258de8effd1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a6c expref: 11 pid: 8384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.571749:0:8384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000007f2812b/0x26940258de8effd1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a6c expref: 11 pid: 8384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.571767:0:8384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8681678000, rc 0) 00000100:00100000:3.0:1789776571.571834:0:8384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba7d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0795fb8a-e14a-4768-806c-f332ad101de7+11:2355:x1876716462109440:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 220us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776571.571841:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 63 00000100:00100000:0.0:1789776571.575592:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776571.575844:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462109696 00000100:00100000:1.0:1789776571.575856:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462109696 00000100:00100000:1.0:1789776571.576037:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 226 00000100:00100000:1.0:1789776571.576049:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+66:11598:x1876716462109696:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789776571.576169:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+66:11598:x1876716462109696:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 123us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776571.576176:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 226 00000100:00100000:0.0:1789776571.580005:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776571.580150:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462109824 00000100:00100000:3.0:1789776571.580162:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462109824 00000100:00100000:3.0:1789776571.580258:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 64 00000100:00100000:3.0:1789776571.580269:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+11:11598:x1876716462109824:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789776571.580286:0:6661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776571.580307:0:6661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af61379a/0x26940258de8effd8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2a73 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.580339:0:6661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000007f2812b/0x26940258de8effd1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a6c expref: 12 pid: 8384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.580348:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789776571.580353:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789776571.580358:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af61379a/0x26940258de8effd8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a73 expref: 12 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.580394:0:6661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000007f2812b/0x26940258de8effd1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a6c expref: 12 pid: 8384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.580410:0:6661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000007f2812b/0x26940258de8effd1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a6c expref: 12 pid: 8384 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776571.580424:0:6661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf298700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6661:1876716471530368:192.168.202.6@tcp:104: 00000100:00100000:3.0:1789776571.580513:0:6661:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8582caecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776571.585194:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776571.585305:0:11143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462109952 00000100:00100000:2.0:1789776571.585317:0:11143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462109952 00010000:00010000:2.0:1789776571.585365:0:11143:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000007f2812b/0x26940258de8effd1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a6c expref: 13 pid: 8384 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776571.585404:0:11143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 81 00000100:00100000:2.0:1789776571.585430:0:11143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0795fb8a-e14a-4768-806c-f332ad101de7+13:2357:x1876716462109952:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789776571.585447:0:11143:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776571.585472:0:11143:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000007f2812b/0x26940258de8effd1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a6c expref: 13 pid: 8384 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.585489:0:11143:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000007f2812b/0x26940258de8effd1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a6c expref: 13 pid: 8384 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.585521:0:11143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776571.585527:0:11143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776571.585536:0:11143:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000af61379a/0x26940258de8effd8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a73 expref: 13 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.585546:0:11143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af61379a/0x26940258de8effd8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a73 expref: 13 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.585599:0:11143:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000af61379a/0x26940258de8effd8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a73 expref: 13 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776571.585627:0:11143:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb54fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11143:1876716471530496:192.168.202.6@tcp:105: 00000100:00100000:2.0:1789776571.585726:0:11143:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf30e240 going to sleep for 11 seconds 00010000:00010000:3.0:1789776571.586688:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007f2812b/0x26940258de8effd1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a6c expref: 13 pid: 8384 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776571.586722:0:6661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf298700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6661:1876716471530368:192.168.202.6@tcp:104: 00010000:00010000:3.0:1789776571.586752:0:6661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000af61379a/0x26940258de8effd8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a73 expref: 12 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.586766:0:6661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8681679200, rc 0) 00000100:00100000:3.0:1789776571.586816:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+12:11598:x1876716462109824:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 6549us (6821us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776571.586824:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 64 00000100:00100000:0.0:1789776571.593640:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776571.593786:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462110080 00000100:00100000:3.0:1789776571.593795:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462110080 00002000:00100000:3.0:1789776571.593871:0:6665:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9c86babc2d80 x1876716462110080/t0(0) o4->0795fb8a-e14a-4768-806c-f332ad101de7@192.168.202.6@tcp:7/0 lens 504/0 e 0 to 0 dl 1789776582 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789776571.593882:0:6665:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c86babc2d80 with x1876716462110080 ext(0->12) 00002000:00010000:3.0:1789776571.593887:0:6665:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c86babc2d80 00000100:00100000:3.0:1789776571.593949:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 6 00000100:00100000:3.0:1789776571.593960:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0795fb8a-e14a-4768-806c-f332ad101de7+12:2356:x1876716462110080:12345-192.168.202.6@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789776571.594432:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0795fb8a-e14a-4768-806c-f332ad101de7+14:2356:x1876716462110080:12345-192.168.202.6@tcp:4:lhsmtool_posix.0 Request processed in 471us (798us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1789776571.594441:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 6 00002000:00100000:3.0:1789776571.594448:0:6665:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9c86babc2d80 x1876716462110080/t4294967320(0) o4->0795fb8a-e14a-4768-806c-f332ad101de7@192.168.202.6@tcp:7/0 lens 504/448 e 0 to 0 dl 1789776582 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789776571.594457:0:6665:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c86babc2d80 with x1876716462110080 ext(0->12) 00002000:00010000:3.0:1789776571.594468:0:6665:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c86babc2d80 00000100:00100000:2.0:1789776571.595429:0:11143:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb54fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11143:1876716471530496:192.168.202.6@tcp:105: 00010000:00010000:2.0:1789776571.595454:0:11143:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776571.595499:0:11143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0795fb8a-e14a-4768-806c-f332ad101de7+13:2357:x1876716462109952:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 10073us (10318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776571.595518:0:11143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 81 00000100:00100000:0.0:1789776571.600793:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776571.600880:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462110208 00000100:00100000:3.0:1789776571.600892:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462110208 00000100:00100000:3.0:1789776571.600976:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 227 00000100:00100000:3.0:1789776571.600986:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+66:11598:x1876716462110208:12345-192.168.202.6@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789776571.645449:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967502 is committed 00000020:00080000:0.0:1789776571.645475:0:5833:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c86aa4a46c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1789776571.645481:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c86b9e3ea00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c86aa4a49c0 00000020:00080000:0.0:1789776571.645484:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c86b9e3e700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c86a0b41400 00000001:00080000:0.0:1789776571.645498:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:0.0:1789776571.645502:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:0.0:1789776571.645520:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1789776571.645532:0:5833:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c8692399c00 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1789776571.645535:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c8690125700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c8692399540 00000020:00080000:0.0:1789776571.645538:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c8698635f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c86bf318c00 00000004:00080000:0.0:1789776571.645545:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000001:00080000:0.0:1789776571.645553:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000020:00080000:0.0:1789776571.645737:0:5844:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1789776571.646025:0:5844:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1789776571.646281:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471530624:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789776571.646399:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471530880:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789776571.646430:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776571.646463:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471530624 00000100:00100000:2.0:1789776571.646474:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471530624 00000100:00100000:2.0:1789776571.646531:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789776571.646547:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bfeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3275:x1876716471530624:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789776571.646582:0:6662:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:2.0:1789776571.646687:0:6662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef25f3f2/0x26940258de8effdf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.646795:0:6662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d4e151d0/0x26940258de8efda1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29d2 expref: 12 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.646807:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1789776571.646811:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789776571.646816:0:6662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef25f3f2/0x26940258de8effdf lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.646845:0:6662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d4e151d0/0x26940258de8efda1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29d2 expref: 12 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.646860:0:6662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d4e151d0/0x26940258de8efda1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29d2 expref: 12 pid: 6659 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776571.646875:0:6662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb54fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6662:1876716471531008:192.168.202.6@tcp:104: 00000100:00100000:0.0:1789776571.647025:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471530752:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789776571.647730:0:6662:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf30e240 going to sleep for 11 seconds 00000100:00100000:2.0:1789776571.647750:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776571.647793:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471530880 00000100:00100000:2.0:1789776571.647799:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471530880 00000100:00100000:2.0:1789776571.647840:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789776571.647848:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471530880:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789776571.647868:0:6659:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:2.0:1789776571.648008:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aadd2ba, atime: 0x6aadd2bb, ctime: 0x6aadd2ba, blocks: 0xb 00010000:00010000:2.0:1789776571.648015:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7bfeee2/0x26940258de8effe6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.648028:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=324s v=(0 0) 00010000:00010000:2.0:1789776571.648032:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776571.648038:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7bfeee2/0x26940258de8effe6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.648053:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7bfeee2/0x26940258de8effe6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.648063:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7bfeee2/0x26940258de8effe6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.648071:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7bfeee2/0x26940258de8effe6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.648090:0:6659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789776571.649135:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3273:x1876716471530880:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1283us (1379us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789776571.649153:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789776571.649240:0:3273:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:2.0:1789776571.649246:0:3273:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c86bb54d880, transno 4294967307 00000004:00080000:2.0:1789776571.649258:0:3273:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:2.0:1789776571.649282:0:3273:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9c86ba374e00 x1876716471530880/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789776587 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1789776571.649293:0:3273:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c86ba374e00/2, rc 0, transno 4294967310 00000100:00100000:2.0:1789776571.649298:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471530880:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789776571.650039:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789776571.651002:0:8420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789776571.651013:0:8420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7bfeee2/0x26940258de8effe6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.651026:0:8420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8686775a00 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:0.0:1789776571.651031:0:8420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7bfeee2/0x26940258de8effe6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.651041:0:8420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7bfeee2/0x26940258de8effe6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.651074:0:8420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7bfeee2/0x26940258de8effe6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.651082:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7bfeee2/0x26940258de8effe6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.651104:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776571.651106:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776571.651107:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776571.659400:0:8384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471530752 00000100:00100000:2.0:1789776571.659413:0:8384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471530752 00000100:00100000:2.0:1789776571.659480:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789776571.659489:0:8384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba376a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3276:x1876716471530752:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789776571.659675:0:8384:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789776571.659679:0:8384:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789776572 00002000:00010000:2.0:1789776571.659681:0:8384:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789776571.659684:0:8384:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1789776572 -> 1789776572 00002000:00010000:2.0:1789776571.659687:0:8384:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789776571.659779:0:8384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba376a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3276:x1876716471530752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 291us (9742us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1789776571.659792:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:1.0:1789776571.660001:0:3276:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c86ba376d80/2, rc 0, transno 4294967321 00000100:00100000:1.0:1789776571.660010:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471530752:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789776571.660467:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+20:11598:x1876716462110208:12345-192.168.202.6@tcp:44:lhsmtool_posix.0 Request processed in 59478us (59680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776571.660477:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 227 00000100:00100000:1.0:1789776571.660552:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776571.660732:0:6662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb54fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6662:1876716471531008:192.168.202.6@tcp:104: 00010000:00010000:2.0:1789776571.660752:0:6662:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ef25f3f2/0x26940258de8effdf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776571.666585:0:11144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462110336 00000100:00100000:3.0:1789776571.666600:0:11144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462110336 00010000:00010000:3.0:1789776571.666655:0:11144:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d4e151d0/0x26940258de8efda1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29d2 expref: 13 pid: 6659 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776571.666699:0:11144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 82 00000100:00100000:3.0:1789776571.666709:0:11144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bfeb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0795fb8a-e14a-4768-806c-f332ad101de7+13:2357:x1876716462110336:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789776571.666724:0:11144:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789776571.666724:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00010000:3.0:1789776571.666729:0:11144:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d4e151d0/0x26940258de8efda1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29d2 expref: 13 pid: 6659 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.666743:0:11144:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d4e151d0/0x26940258de8efda1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29d2 expref: 13 pid: 6659 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776571.666757:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462110464 00000100:00100000:1.0:1789776571.666761:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462110464 00010000:00010000:3.0:1789776571.666766:0:11144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4e151d0/0x26940258de8efda1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29d2 expref: 14 pid: 6659 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.666784:0:11144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00000100:00100000:1.0:1789776571.666801:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 68 00010000:00010000:3.0:1789776571.666802:0:11144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789776571.666809:0:11144:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ef25f3f2/0x26940258de8effdf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776571.666809:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bfeb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0795fb8a-e14a-4768-806c-f332ad101de7+13:2354:x1876716462110464:12345-192.168.202.6@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1789776571.666819:0:11144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef25f3f2/0x26940258de8effdf lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.666853:0:11144:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776571.666910:0:11144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bfeb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0795fb8a-e14a-4768-806c-f332ad101de7+13:2357:x1876716462110336:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 201us (6358us total) trans 0 rc 0/0 00010000:00010000:2.0:1789776571.666927:0:6662:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ef25f3f2/0x26940258de8effdf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776571.666928:0:11144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 82 00010000:00010000:2.0:1789776571.666945:0:6662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef25f3f2/0x26940258de8effdf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.666956:0:6662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef25f3f2/0x26940258de8effdf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.666965:0:6662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef25f3f2/0x26940258de8effdf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.666983:0:6662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789776571.667589:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bfeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3275:x1876716471530624:12345-0@lo:6:osp-syn-0-0.0 Request processed in 21047us (21157us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1789776571.667597:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:2.0:1789776571.667633:0:8419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776571.667640:0:8419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef25f3f2/0x26940258de8effdf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.667649:0:8419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8686774200 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:2.0:1789776571.667653:0:8419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef25f3f2/0x26940258de8effdf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.667664:0:8419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef25f3f2/0x26940258de8effdf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789776571.667674:0:3275:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c86ba374380/2, rc 0, transno 4294967322 00010000:00010000:2.0:1789776571.667678:0:8419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef25f3f2/0x26940258de8effdf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776571.667683:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471530624:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1789776571.667697:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef25f3f2/0x26940258de8effdf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.667716:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776571.667718:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776571.667719:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789776571.708254:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000001:00080000:0.0:1789776571.708423:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:0.0:1789776571.708432:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:0.0:1789776571.708443:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:2.0:1789776571.708756:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bfeb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0795fb8a-e14a-4768-806c-f332ad101de7+7:2354:x1876716462110464:12345-192.168.202.6@tcp:16:lhsmtool_posix.0 Request processed in 41941us (42026us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776571.708769:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 68 00000100:00100000:1.0:1789776571.715391:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776571.715598:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462110720 00000100:00100000:2.0:1789776571.715730:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462110720 00000100:00100000:2.0:1789776571.715832:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 228 00000100:00100000:2.0:1789776571.715843:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bfeb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+20:11598:x1876716462110720:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789776571.715906:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776571.715948:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678a00/0x26940258de8effca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a65 expref: 20 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.715972:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c8683789600) 00010000:00010000:2.0:1789776571.715978:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789776571.716015:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8effed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.716031:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8effed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.716043:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8effed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789776571.717100:0:5813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005790851d reply state 00000000a309cabe transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8effed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776571.717113:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789776571.717269:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bfeb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+21:11598:x1876716462110720:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 Request processed in 1426us (1887us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1789776571.717277:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 228 00000100:00100000:0.0:1789776571.725963:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776571.726005:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462110848 00000100:00100000:0.0:1789776571.726016:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462110848 00000100:00100000:0.0:1789776571.726071:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 69 00000100:00100000:0.0:1789776571.726082:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa656300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+7:2357:x1876716462110848:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789776571.726363:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1789776571.726379:0:6661:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1789776572 -> 1789776571 00002000:00010000:0.0:1789776571.726382:0:6661:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1789776571 00002000:00010000:0.0:1789776571.726384:0:6661:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1789776572 -> 1789776571 00002000:00010000:0.0:1789776571.726386:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789776571.726443:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa656300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+8:2357:x1876716462110848:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 Request processed in 361us (491us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1789776571.726451:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 69 00010000:00010000:2.0:1789776571.726934:0:3259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8effed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.726947:0:3259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8effed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.726955:0:3259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8effed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.726963:0:3259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8686774200 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776571.726969:0:3259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8effed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.726978:0:3259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8effed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.726995:0:3259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c8683789600) 00010000:00010000:2.0:1789776571.726999:0:3259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776571.727005:0:3259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8effed lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.727011:0:3259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8effed lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776571.733804:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776571.733893:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462111104 00000100:00100000:3.0:1789776571.733905:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462111104 00000100:00100000:3.0:1789776571.733982:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 229 00000100:00100000:3.0:1789776571.733992:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+20:11598:x1876716462111104:12345-192.168.202.6@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789776571.734252:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efff4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.734272:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8effae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a57 expref: 20 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.734282:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efff4 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.734329:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8effae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a57 expref: 20 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.734367:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8effae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a57 expref: 20 pid: 5811 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776571.734384:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf298700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1876716471531136:192.168.202.6@tcp:104: 00000100:00100000:3.0:1789776571.734505:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8582cae0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776571.737212:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf298700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1876716471531136:192.168.202.6@tcp:104: 00010000:00010000:3.0:1789776571.737269:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efff4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776571.738855:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776571.738949:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462111232 00000100:00100000:0.0:1789776571.738958:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462111232 00010000:00010000:0.0:1789776571.738993:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8effae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a57 expref: 21 pid: 5811 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776571.739031:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 83 00000100:00100000:0.0:1789776571.739039:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0795fb8a-e14a-4768-806c-f332ad101de7+21:2356:x1876716462111232:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789776571.739053:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776571.739060:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8effae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a57 expref: 21 pid: 5811 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.739073:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8effae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a57 expref: 21 pid: 5811 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.739103:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8effae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a57 expref: 21 pid: 5811 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.739120:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c8683789600) 00010000:00010000:0.0:1789776571.739125:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efff4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.739149:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efff4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.739157:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efff4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.739182:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776571.739273:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0795fb8a-e14a-4768-806c-f332ad101de7+20:2356:x1876716462111232:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 234us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776571.739281:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 83 00010000:00010000:3.0:1789776571.739583:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efff4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.739592:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efff4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.739710:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efff4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.739718:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efff4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.739724:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efff4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.739730:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681679c00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776571.739735:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efff4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.739755:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efff4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.739765:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c8683789600) 00010000:00010000:3.0:1789776571.739768:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789776571.739771:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efff4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.739778:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8efff4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776571.739833:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+19:11598:x1876716462111104:12345-192.168.202.6@tcp:55:lhsmtool_posix.0 Request processed in 5842us (6038us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789776571.739841:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 229 00000100:00100000:1.0:1789776571.749473:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776571.749594:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462111360 00000100:00100000:2.0:1789776571.749605:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462111360 00000100:00100000:2.0:1789776571.749666:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 70 00000100:00100000:2.0:1789776571.749677:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0795fb8a-e14a-4768-806c-f332ad101de7+8:2356:x1876716462111360:12345-192.168.202.6@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789776571.749723:0:6662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ef25f3f2/0x26940258de8efffb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.749757:0:6662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000af61379a/0x26940258de8effd8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a73 expref: 8 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.749767:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776571.749771:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789776571.749776:0:6662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef25f3f2/0x26940258de8efffb lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.749812:0:6662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000af61379a/0x26940258de8effd8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a73 expref: 8 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.749826:0:6662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000af61379a/0x26940258de8effd8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a73 expref: 8 pid: 6661 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776571.749842:0:6662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb54fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6662:1876716471531264:192.168.202.6@tcp:104: 00000100:00100000:2.0:1789776571.749936:0:6662:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf30eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789776571.756303:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776571.756505:0:6662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb54fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6662:1876716471531264:192.168.202.6@tcp:104: 00010000:00010000:2.0:1789776571.756536:0:6662:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ef25f3f2/0x26940258de8efffb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776571.756654:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462111488 00000100:00100000:1.0:1789776571.756662:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462111488 00010000:00010000:1.0:1789776571.756704:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000af61379a/0x26940258de8effd8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a73 expref: 9 pid: 6661 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776571.756780:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 84 00000100:00100000:1.0:1789776571.756791:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa655500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0795fb8a-e14a-4768-806c-f332ad101de7+9:2357:x1876716462111488:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776571.756807:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776571.756830:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000af61379a/0x26940258de8effd8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a73 expref: 9 pid: 6661 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.756844:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000af61379a/0x26940258de8effd8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a73 expref: 9 pid: 6661 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.756867:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af61379a/0x26940258de8effd8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a73 expref: 9 pid: 6661 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.756883:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789776571.756887:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789776571.756893:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ef25f3f2/0x26940258de8efffb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.756903:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef25f3f2/0x26940258de8efffb lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.756952:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776571.757019:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa655500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0795fb8a-e14a-4768-806c-f332ad101de7+8:2357:x1876716462111488:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 229us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776571.757042:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 84 00010000:00010000:3.0:1789776571.757116:0:6662:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ef25f3f2/0x26940258de8efffb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.757125:0:6662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef25f3f2/0x26940258de8efffb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.757149:0:6662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ef25f3f2/0x26940258de8efffb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.757158:0:6662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef25f3f2/0x26940258de8efffb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.757165:0:6662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef25f3f2/0x26940258de8efffb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.757177:0:6662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8686774200 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:3.0:1789776571.757181:0:6662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef25f3f2/0x26940258de8efffb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.757199:0:6662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef25f3f2/0x26940258de8efffb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.757212:0:6662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef25f3f2/0x26940258de8efffb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.757239:0:6662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef25f3f2/0x26940258de8efffb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776571.757289:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0795fb8a-e14a-4768-806c-f332ad101de7+7:2356:x1876716462111360:12345-192.168.202.6@tcp:1:lhsmtool_posix.0 Request processed in 7614us (7826us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776571.757297:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 70 00000100:00100000:0.0:1789776571.765550:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776571.765632:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462111744 00000100:00100000:1.0:1789776571.765643:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462111744 00000100:00100000:1.0:1789776571.765703:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 230 00000100:00100000:1.0:1789776571.765711:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa654380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+19:11598:x1876716462111744:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789776571.765809:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8f0002 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.765829:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8f0002 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.765841:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8f0002 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.766090:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8f0009 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.766099:0:8177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8effbc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a5e expref: 20 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.766106:0:8177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8f0009 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.766137:0:8177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8effbc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a5e expref: 20 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.766149:0:8177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8effbc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a5e expref: 20 pid: 5811 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776571.766177:0:8177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf34c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8177:1876716471531392:192.168.202.6@tcp:104: 00000100:00100000:1.0:1789776571.766288:0:8177:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c868ac64240 going to sleep for 11 seconds 00000100:00100000:0.0:1789776571.769690:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776571.769774:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462111872 00000100:00100000:2.0:1789776571.769793:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462111872 00010000:00010000:2.0:1789776571.769843:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8effbc lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a5e expref: 21 pid: 5811 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776571.769904:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 85 00000100:00100000:2.0:1789776571.769922:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf295f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0795fb8a-e14a-4768-806c-f332ad101de7+21:2357:x1876716462111872:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789776571.769938:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776571.769946:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8effbc lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a5e expref: 21 pid: 5811 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.769960:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8effbc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a5e expref: 21 pid: 5811 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.769984:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c8683789600) 00010000:00010000:2.0:1789776571.769990:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8f0009 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.770000:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8f0009 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.770006:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8f0009 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.770026:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776571.770206:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf295f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0795fb8a-e14a-4768-806c-f332ad101de7+21:2357:x1876716462111872:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 293us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776571.770212:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 85 00010000:00010000:1.0:1789776571.770563:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8effbc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a5e expref: 20 pid: 5811 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776571.770582:0:8177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf34c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8177:1876716471531392:192.168.202.6@tcp:104: 00010000:00010000:1.0:1789776571.770606:0:8177:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8f0009 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.770616:0:8177:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8f0009 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.770622:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8f0009 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789776571.770853:0:8177:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:1.0:1789776571.771023:0:8177:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1789776571.771069:0:8177:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1789776571.771578:0:8177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb54fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8177:1876716471531520:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789776571.771640:0:8177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776571.771677:0:8177:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf30ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1789776571.771768:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471531520 00000100:00100000:3.0:1789776571.771775:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471531520 00000100:00100000:3.0:1789776571.771838:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789776571.771847:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb54d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8177:x1876716471531520:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789776571.771939:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb54d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8177:x1876716471531520:12345-0@lo:1000:mdt00_003.0 Request processed in 92us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776571.771946:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789776571.773248:0:8177:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:2.0:1789776571.773259:0:8177:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:2.0:1789776571.773285:0:8177:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c86ba376d80, transno 4294967321 00000004:00080000:2.0:1789776571.773296:0:8177:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c86ba374380, transno 4294967322 00000100:00100000:2.0:1789776571.773304:0:8177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb54fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8177:1876716471531520:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1789776571.773783:0:8177:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1789776571.773857:0:8177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb54fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8177:1876716471531648:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789776571.773903:0:8177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776571.773949:0:8177:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf30e900 going to sleep for 11 seconds 00000100:00100000:2.0:1789776571.773974:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471531648 00000100:00100000:2.0:1789776571.773979:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471531648 00000100:00100000:2.0:1789776571.774008:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789776571.774015:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb54f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8177:x1876716471531648:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789776571.774549:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb54f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8177:x1876716471531648:12345-0@lo:1000:mdt00_003.0 Request processed in 533us (645us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1789776571.774555:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789776571.776016:0:8177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb54fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8177:1876716471531648:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1789776571.776082:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8f0009 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.776090:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8f0009 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.776096:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8f0009 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.776100:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5ca600 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776571.776104:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8f0009 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.776109:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8f0009 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.776124:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c8683789600) 00010000:00010000:3.0:1789776571.776126:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789776571.776131:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8f0009 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.776135:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca600/0x26940258de8f0009 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.776166:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8eff4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.776169:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8eff4c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.776173:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8eff4c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.776183:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5ca200 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776571.776185:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8eff4c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.776188:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8eff4c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.776200:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c8683789800) 00010000:00010000:3.0:1789776571.776201:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789776571.776206:0:8177:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8eff53 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a42 expref: 23 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.776246:0:8177:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8eff53 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a42 expref: 23 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.776254:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8eff53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a42 expref: 23 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.776280:0:8177:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8eff53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a42 expref: 23 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776571.776288:0:8177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf298700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8177:1876716471531776:192.168.202.6@tcp:105: 00000100:00100000:3.0:1789776571.776348:0:8177:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8582cae0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776571.781327:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776571.781371:0:8177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf298700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8177:1876716471531776:192.168.202.6@tcp:105: 00010000:00010000:3.0:1789776571.781407:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8eff4c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.781439:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5ca200/0x26940258de8eff4c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.781477:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8f0010 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.781491:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8f0010 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.781502:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8f0010 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.781512:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8f0010 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.781518:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8f0010 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776571.781518:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462112000 00010000:00010000:3.0:1789776571.781523:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8f0010 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776571.781526:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462112000 00010000:00010000:3.0:1789776571.781529:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681679c00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776571.781533:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8f0010 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.781540:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8f0010 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.781550:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c8683789800) 00010000:00010000:3.0:1789776571.781553:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776571.781557:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8f0010 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.781578:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8f0010 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776571.781583:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 61 00010000:00010000:3.0:1789776571.781590:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8f0002 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776571.781592:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf34c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+24:11597:x1876716462112000:12345-192.168.202.6@tcp:49:lfs.0 00010000:00010000:3.0:1789776571.781596:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8f0002 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.781601:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8f0002 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.781606:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5cb600 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776571.781617:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8f0002 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.781622:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8f0002 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.781630:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c8683789800) 00010000:00010000:3.0:1789776571.781632:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789776571.781634:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8f0002 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.781639:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb600/0x26940258de8f0002 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776571.781738:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf34c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+24:11597:x1876716462112000:12345-192.168.202.6@tcp:49:lfs.0 Request processed in 146us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776571.781746:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 61 00000100:00100000:3.0:1789776571.781866:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa654380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+23:11598:x1876716462111744:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 16154us (16324us total) trans 4294967512 rc 0/0 00000100:00100000:3.0:1789776571.781875:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 230 00000020:00080000:3.0:1789776571.781889:0:8177:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789776571.782614:0:11658:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789776571.782621:0:11658:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789776571.783318:0:11658:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1789776571.783328:0:11658:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789776571.786464:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776571.788253:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462112256 00000100:00100000:3.0:1789776571.788271:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462112256 00000100:00100000:3.0:1789776571.788505:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 62 00000100:00100000:2.0:1789776571.788722:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa27cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+23:11598:x1876716462112256:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789776571.791481:0:5815:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:1.0:1789776571.792114:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000001:00080000:2.0:1789776571.792213:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:0.0:1789776571.792306:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462112512 00000100:00100000:0.0:1789776571.792315:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462112512 00010000:00010000:2.0:1789776571.792318:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774600/0x26940258de8f0017 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.792335:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774600/0x26940258de8f0017 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.792346:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774600/0x26940258de8f0017 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.792365:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774600/0x26940258de8f0017 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776571.792365:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 231 00010000:00010000:2.0:1789776571.792372:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774600/0x26940258de8f0017 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776571.792374:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf34d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+26:11597:x1876716462112512:12345-192.168.202.6@tcp:58:lfs.0 00010000:00010000:2.0:1789776571.792379:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774600/0x26940258de8f0017 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776571.792402:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789776571.792490:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa27cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+26:11598:x1876716462112256:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 Request processed in 3974us (6036us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1789776571.792498:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 62 00000020:00080000:2.0:1789776571.792503:0:5815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:0.0:1789776571.792573:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1789776571.792612:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf34d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+25:11597:x1876716462112512:12345-192.168.202.6@tcp:58:lfs.0 Request processed in 239us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776571.792619:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 231 00010000:00010000:1.0:1789776571.792759:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776571.792767:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774600/0x26940258de8f0017 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.792774:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8686774600 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:1.0:1789776571.792778:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774600/0x26940258de8f0017 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.796416:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774600/0x26940258de8f0017 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.796437:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c86881a7700) 00010000:00010000:1.0:1789776571.796440:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789776571.796447:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774600/0x26940258de8f0017 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.796453:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774600/0x26940258de8f0017 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.796555:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776571.796559:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776571.796562:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776571.797459:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9dec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3276:1876716471532160:0@lo:400:kworker.0 00000100:00100000:2.0:1789776571.797530:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776571.797580:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789776571.797597:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb54ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876716471532032:0@lo:400:kworker.0 00000100:00100000:2.0:1789776571.797630:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776571.797878:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb54ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9db43398-240e-4f78-8778-c11d527e09a1:3274:1876716471531904:0@lo:400:kworker.0 00000100:00100000:0.0:1789776571.797936:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776571.797966:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba3bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3273:1876716471532288:0@lo:400:kworker.0 00000100:00100000:0.0:1789776571.797990:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471532160 00000100:00100000:3.0:1789776571.797997:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776571.798003:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471532160 00000100:00100000:3.0:1789776571.798028:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471532032 00000100:00100000:3.0:1789776571.798031:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471532032 00000100:00100000:0.0:1789776571.798053:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471532288 00000100:00100000:0.0:1789776571.798056:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471532288 00000100:00100000:1.0:1789776571.798074:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471531904 00000100:00100000:1.0:1789776571.798088:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471531904 00000100:00100000:1.0:1789776571.798119:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1789776571.798128:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa597c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+19:3274:x1876716471531904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776571.798201:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa597c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+19:3274:x1876716471531904:12345-0@lo:400:kworker.0 Request processed in 74us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776571.798209:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1789776571.798253:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb54ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9db43398-240e-4f78-8778-c11d527e09a1:3274:1876716471531904:0@lo:400:kworker.0 00000100:00080000:1.0:1789776571.799405:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789776571.803253:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789776571.803286:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876716471532160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776571.803542:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876716471532160:12345-0@lo:400:kworker.0 Request processed in 273us (6009us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776571.803551:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789776571.803583:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789776571.803590:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba20f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876716471532032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776571.803694:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba20f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876716471532032:12345-0@lo:400:kworker.0 Request processed in 104us (6062us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776571.803701:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789776571.803717:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789776571.803724:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf298700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1876716471532288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776571.803764:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf298700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1876716471532288:12345-0@lo:400:kworker.0 Request processed in 41us (5766us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776571.803770:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789776571.803812:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba3bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3273:1876716471532288:0@lo:400:kworker.0 00000100:00100000:2.0:1789776571.807350:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9dec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3276:1876716471532160:0@lo:400:kworker.0 00000100:00100000:2.0:1789776571.807411:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb54ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876716471532032:0@lo:400:kworker.0 00000100:00100000:2.0:1789776571.842543:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776571.842784:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462112640 00000100:00100000:0.0:1789776571.842795:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462112640 00000100:00100000:0.0:1789776571.842863:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 232 00000100:00100000:0.0:1789776571.842874:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba20df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+25:11600:x1876716462112640:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1789776571.842911:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776571.842954:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8f001e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2a7a expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.843040:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8f0025 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.843054:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8f0025 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.843064:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8f0025 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.843078:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08200/0x26940258de8f002c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.843084:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08200/0x26940258de8f002c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776571.843101:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08200/0x26940258de8f002c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.843973:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8f0033 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.843988:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8eff3e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a3b expref: 26 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.843997:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8f0033 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.844031:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8eff3e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a3b expref: 26 pid: 8177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.844054:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8eff3e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a3b expref: 26 pid: 8177 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776571.844069:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf34df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1876716471532416:192.168.202.6@tcp:104: 00000100:00100000:1.0:1789776571.844181:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8698642540 going to sleep for 11 seconds 00000100:00100000:1.0:1789776571.848089:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf34df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1876716471532416:192.168.202.6@tcp:104: 00010000:00010000:1.0:1789776571.848131:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8f0033 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776571.849883:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776571.850064:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462112896 00000100:00100000:1.0:1789776571.850076:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462112896 00000100:00100000:1.0:1789776571.850149:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 63 00000100:00100000:1.0:1789776571.850159:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba20e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+27:5596:x1876716462112896:12345-192.168.202.6@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789776571.850477:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba20e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+28:5596:x1876716462112896:12345-192.168.202.6@tcp:35:ldlm_bl.0 Request processed in 318us (602us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1789776571.850485:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 63 00000100:00100000:0.0:1789776571.856029:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776571.856404:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462113024 00000100:00100000:1.0:1789776571.856416:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462113024 00010000:00010000:1.0:1789776571.856460:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8eff3e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a3b expref: 28 pid: 8177 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776571.856509:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 86 00000100:00100000:1.0:1789776571.856519:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf297800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0795fb8a-e14a-4768-806c-f332ad101de7+28:2356:x1876716462113024:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776571.856541:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776571.856566:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8eff3e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a3b expref: 28 pid: 8177 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.856593:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8eff3e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a3b expref: 28 pid: 8177 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.856858:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb200/0x26940258de8eff3e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a3b expref: 28 pid: 8177 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.856877:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c8683789800) 00010000:00010000:1.0:1789776571.856883:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8f0033 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.856905:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8f0033 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.856923:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8f0033 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776571.856963:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776571.857065:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf297800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0795fb8a-e14a-4768-806c-f332ad101de7+27:2356:x1876716462113024:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 546us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776571.857074:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 86 00010000:00010000:3.0:1789776571.857385:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8f0033 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.857397:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8f0033 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776571.857451:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789776571.857458:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789776571.857483:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8f0033 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.857496:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8f0033 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.857506:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8f0025 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.857513:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8f0025 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.857519:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8f0025 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.857525:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b08a00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776571.857529:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8f0025 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.857549:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8f0025 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.857560:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:3.0:1789776571.857576:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776571.857582:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8f0025 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.857588:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8f0025 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.857612:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08200/0x26940258de8f002c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.857619:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08200/0x26940258de8f002c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.857625:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08200/0x26940258de8f002c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.857630:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b08200 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776571.857633:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08200/0x26940258de8f002c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.857639:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08200/0x26940258de8f002c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.857646:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c86a08dfa00) 00010000:00010000:3.0:1789776571.857649:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776571.857652:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08200/0x26940258de8f002c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.857668:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08200/0x26940258de8f002c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.857711:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08400/0x26940258de8f001e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a7a expref: 27 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.857725:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8f0033 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a7a expref: 26 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776571.857733:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c8683789800) 00010000:00010000:3.0:1789776571.857735:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789776571.857738:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86bf5cb400, rc 0) 00000100:00100000:3.0:1789776571.857771:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba20df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0795fb8a-e14a-4768-806c-f332ad101de7+26:11600:x1876716462112640:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 14899us (15238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776571.857777:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 232 00000100:00100000:1.0:1789776572.308735:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789776572.308759:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf295c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471532544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789776572.308829:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789776572.308962:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776572.309007:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471532544 00000100:00100000:0.0:1789776572.309015:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471532544 00000100:00100000:0.0:1789776572.309083:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789776572.309104:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf34df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3273:x1876716471532544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789776572.309150:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789776572.309205:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf34df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3273:x1876716471532544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776572.309212:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789776572.309281:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf295c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471532544:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789776572.309559:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1789776572.779038:0:12486:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789776572.779048:0:12486:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789776572.779095:0:12486:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789776572.779101:0:12486:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1789776572.828789:0:11658:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789776572.828801:0:11658:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789776572.828864:0:11658:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789776572.828870:0:11658:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789776572.829016:0:11658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf295c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11658:1876716471532672:192.168.202.6@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789776572.829129:0:11658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c869866bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776572.845566:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776572.846363:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462113152 00000100:00100000:3.0:1789776572.846374:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462113152 00000100:00100000:3.0:1789776572.846447:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 233 00000100:00100000:3.0:1789776572.846460:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+27:11612:x1876716462113152:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789776572.846500:0:5812:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789776572.846638:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0795fb8a-e14a-4768-806c-f332ad101de7+27:11612:x1876716462113152:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 Request processed in 180us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776572.846647:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 233 00000100:00100000:2.0:1789776572.847433:0:11658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf295c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11658:1876716471532672:192.168.202.6@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789776572.850378:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776572.851193:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462113408 00000100:00100000:0.0:1789776572.851207:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462113408 00000100:00100000:0.0:1789776572.851288:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 234 00000100:00100000:0.0:1789776572.851298:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba20fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+26:11612:x1876716462113408:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789776572.851318:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776572.851340:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8f003a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2a81 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776572.851437:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09e00/0x26940258de8f0041 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776572.851453:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09e00/0x26940258de8f0041 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776572.851464:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09e00/0x26940258de8f0041 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776572.851475:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789776572.851599:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8f003a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a81 expref: 29 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776572.851617:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09e00/0x26940258de8f0041 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a81 expref: 28 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776572.851625:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c8683789800) 00010000:00010000:0.0:1789776572.851628:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789776572.851631:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86b9b09e00, rc 0) 00000100:00100000:0.0:1789776572.851694:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba20fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+28:11612:x1876716462113408:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 397us (1326us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1789776572.851700:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 234 00000100:00100000:3.0:1789776572.861827:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776572.862432:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776572.862480:0:11143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462113792 00000100:00100000:3.0:1789776572.862492:0:11143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462113792 00000100:00100000:3.0:1789776572.863332:0:11143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 17 00000100:00100000:3.0:1789776572.863348:0:11143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8698809c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0795fb8a-e14a-4768-806c-f332ad101de7+28:2356:x1876716462113792:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789776572.863369:0:11143:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776572.863402:0:11143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09e00/0x26940258de8f0041 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a81 expref: 28 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776572.863426:0:11143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c8683789800) 00010000:00010000:3.0:1789776572.863431:0:11143:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776572.863501:0:11143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8698809c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0795fb8a-e14a-4768-806c-f332ad101de7+27:2356:x1876716462113792:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 159us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776572.863510:0:11143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 17 00000100:00100000:3.0:1789776572.866178:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462113664 00000100:00100000:3.0:1789776572.866194:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462113664 00000100:00100000:3.0:1789776572.866794:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 235 00000100:00100000:3.0:1789776572.866807:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+27:11612:x1876716462113664:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789776572.866916:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8f004f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776572.866935:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8f004f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776572.866949:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8f004f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776572.867560:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8f004f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776572.867591:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8f004f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776572.868710:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8f004f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776572.868719:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681679c00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776572.868724:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8f004f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776572.868734:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8f004f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776572.868765:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c8683789800) 00010000:00010000:3.0:1789776572.868769:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789776572.868775:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8f004f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776572.868782:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8f004f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776572.869697:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+28:11612:x1876716462113664:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 2760us (7748us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1789776572.869710:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 235 00000040:00080000:0.0:1789776572.870453:0:11658:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789776572.870461:0:11658:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789776572.876951:0:11658:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1789776572.876974:0:11658:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789776572.878449:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776572.880411:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462114048 00000100:00100000:0.0:1789776572.880425:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462114048 00000100:00100000:0.0:1789776572.880511:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 64 00000100:00100000:0.0:1789776572.880522:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+28:11612:x1876716462114048:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789776572.880807:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+29:11612:x1876716462114048:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 Request processed in 285us (2365us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1789776572.880814:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 64 00010000:00010000:2.0:1789776573.334698:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776574.239016:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776574.239065:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776574.239153:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462114560 00000100:00100000:2.0:1789776574.239164:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462114560 00000100:00100000:2.0:1789776574.239275:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 91 00000100:00100000:2.0:1789776574.239287:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bfeb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+5:2354:x1876716462114560:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1789776574.239375:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bfeb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+5:2354:x1876716462114560:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 92us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776574.239383:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 91 00000100:00080000:1.0:1789776574.239999:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789776574.240122:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462114304 00000100:00100000:0.0:1789776574.240128:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462114304 00000100:00100000:0.0:1789776574.240173:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 159 00000100:00100000:0.0:1789776574.240181:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+29:2354:x1876716462114304:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1789776574.240267:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+29:2354:x1876716462114304:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 85us (1262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776574.240274:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 159 00000100:00080000:1.0:1789776574.240332:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789776574.240523:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776574.240857:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776574.240907:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776574.240931:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462114176 00000100:00100000:3.0:1789776574.240935:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462114176 00000100:00100000:3.0:1789776574.240962:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 295 00000100:00100000:3.0:1789776574.240969:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa594850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:2354:x1876716462114176:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1789776574.241001:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa594850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:2354:x1876716462114176:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 33us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776574.241008:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 295 00000100:00100000:2.0:1789776574.241364:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462114688 00000100:00100000:2.0:1789776574.241369:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462114688 00000100:00100000:2.0:1789776574.241414:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 160 00000100:00100000:2.0:1789776574.241421:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa655500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d27fff26-e747-430b-8151-cc0e7e6df617+5:2354:x1876716462114688:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1789776574.241451:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa655500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d27fff26-e747-430b-8151-cc0e7e6df617+5:2354:x1876716462114688:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 30us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776574.241457:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 160 00000100:00100000:1.0:1789776574.241645:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462114432 00000100:00100000:1.0:1789776574.241654:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462114432 00000100:00100000:1.0:1789776574.241686:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 92 00000100:00100000:1.0:1789776574.241703:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0795fb8a-e14a-4768-806c-f332ad101de7+7:2354:x1876716462114432:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1789776574.241891:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0795fb8a-e14a-4768-806c-f332ad101de7+7:2354:x1876716462114432:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 198us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776574.241909:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 92 00000100:00080000:3.0:1789776574.242321:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789776574.242326:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789776574.361824:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789776574.958108:0:12538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789776574.958118:0:12538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789776574.958170:0:12538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789776574.958177:0:12538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789776575.293610:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776575.293734:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462114944 00000100:00100000:0.0:1789776575.293748:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462114944 00000100:00100000:0.0:1789776575.293851:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 236 00000100:00100000:0.0:1789776575.293863:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9dec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+29:11633:x1876716462114944:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1789776575.293894:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776575.293915:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08800/0x26940258de8f0056 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2a88 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776575.294019:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8f005d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776575.294035:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8f005d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776575.294047:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8f005d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776575.294059:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789776575.294513:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08800/0x26940258de8f0056 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a88 expref: 32 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776575.294534:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8f005d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a88 expref: 31 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776575.294542:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c8683789800) 00010000:00010000:0.0:1789776575.294558:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789776575.294563:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86b9b09000, rc 0) 00000100:00100000:0.0:1789776575.294623:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9dec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+31:11633:x1876716462114944:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 762us (1026us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1789776575.294631:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 236 00000100:00100000:0.0:1789776575.302138:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776575.302278:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462115072 00000100:00100000:2.0:1789776575.302289:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462115072 00000100:00100000:2.0:1789776575.302351:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 237 00000100:00100000:2.0:1789776575.302362:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf296300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+31:11633:x1876716462115072:12345-192.168.202.6@tcp:54:lfs.0 00010000:00010000:2.0:1789776575.302435:0:8177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775600/0x26940258de8f006b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776575.302452:0:8177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775600/0x26940258de8f006b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776575.302464:0:8177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775600/0x26940258de8f006b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776575.302491:0:8177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775600/0x26940258de8f006b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776575.302498:0:8177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775600/0x26940258de8f006b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776575.302505:0:8177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775600/0x26940258de8f006b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776575.302512:0:8177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8686775600 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776575.302516:0:8177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775600/0x26940258de8f006b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776575.302536:0:8177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775600/0x26940258de8f006b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776575.302550:0:8177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c8683789800) 00010000:00010000:2.0:1789776575.302553:0:8177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789776575.302558:0:8177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775600/0x26940258de8f006b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776575.302564:0:8177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775600/0x26940258de8f006b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776575.302640:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf296300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+31:11633:x1876716462115072:12345-192.168.202.6@tcp:54:lfs.0 Request processed in 280us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776575.302649:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 237 00010000:00010000:2.0:1789776575.383202:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776575.459344:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776575.459442:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462115200 00000100:00100000:2.0:1789776575.459453:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462115200 00000100:00100000:2.0:1789776575.459512:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 71 00000100:00100000:2.0:1789776575.459523:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf34ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+7:2354:x1876716462115200:12345-192.168.202.6@tcp:101:cat.0 00010000:00010000:2.0:1789776575.459541:0:6661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776575.459564:0:6661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001090c1df/0x26940258de8f0072 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2a8f expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789776575.459592:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aadd2bb, atime: 0x6aadd2bb, ctime: 0x6aadd2bb, blocks: 0xb 00010000:00010000:2.0:1789776575.459613:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=328s v=(0 0) 00010000:00010000:2.0:1789776575.459618:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776575.459627:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001090c1df/0x26940258de8f0072 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a8f expref: 8 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776575.459667:0:6661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001090c1df/0x26940258de8f0072 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a8f expref: 8 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776575.459681:0:6661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8686775600, rc 0) 00000100:00100000:2.0:1789776575.459736:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf34ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+8:2354:x1876716462115200:12345-192.168.202.6@tcp:101:cat.0 Request processed in 216us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776575.459744:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 71 00000100:00100000:0.0:1789776575.472726:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776575.472848:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462115328 00000100:00100000:2.0:1789776575.472859:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462115328 00002000:00100000:2.0:1789776575.472925:0:6667:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9c86bf295f80 x1876716462115328/t0(0) o3->0795fb8a-e14a-4768-806c-f332ad101de7@192.168.202.6@tcp:11/0 lens 488/0 e 0 to 0 dl 1789776586 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789776575.472937:0:6667:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c86bf295f80 with x1876716462115328 ext(0->4095) 00002000:00010000:2.0:1789776575.472944:0:6667:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c86bf295f80 00000100:00100000:2.0:1789776575.472984:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 7 00000100:00100000:2.0:1789776575.472995:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf295f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0795fb8a-e14a-4768-806c-f332ad101de7+8:2355:x1876716462115328:12345-192.168.202.6@tcp:3:cat.0 00000100:00100000:2.0:1789776575.473278:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf295f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0795fb8a-e14a-4768-806c-f332ad101de7+8:2355:x1876716462115328:12345-192.168.202.6@tcp:3:cat.0 Request processed in 283us (564us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789776575.473288:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 7 00002000:00100000:2.0:1789776575.473296:0:6667:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9c86bf295f80 x1876716462115328/t0(0) o3->0795fb8a-e14a-4768-806c-f332ad101de7@192.168.202.6@tcp:11/0 lens 488/4536 e 0 to 0 dl 1789776586 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789776575.473304:0:6667:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c86bf295f80 with x1876716462115328 ext(0->4095) 00002000:00010000:2.0:1789776575.473308:0:6667:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c86bf295f80 00000100:00100000:0.0:1789776575.903314:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789776575.903342:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf297800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471532800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789776575.903419:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776575.903492:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471532800 00000100:00100000:0.0:1789776575.903501:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471532800 00000100:00100000:0.0:1789776575.903559:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789776575.903568:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf295c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3276:x1876716471532800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789776575.903614:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789776575.903664:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf295c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3276:x1876716471532800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776575.903672:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1789776575.903694:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789776575.903736:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf297800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471532800:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1789776575.961248:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:0.0:1789776576.405669:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776576.922955:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c8582a70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9db43398-240e-4f78-8778-c11d527e09a1:3276:1876716471532928:0@lo:400:kworker.0 00000100:00100000:0.0:1789776576.923023:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776576.923063:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9de4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3276:1876716471533440:0@lo:400:kworker.0 00000100:00100000:0.0:1789776576.923082:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776576.923101:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789776576.923112:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9de6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471533312:0@lo:400:kworker.0 00000100:00100000:0.0:1789776576.923131:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776576.923149:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c8582a71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3273:1876716471533056:0@lo:400:kworker.0 00000100:00100000:0.0:1789776576.923165:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776576.923175:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9de4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471533568:0@lo:400:kworker.0 00000100:00100000:0.0:1789776576.923187:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776576.923197:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789776576.923200:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9de6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3273:1876716471533184:0@lo:400:kworker.0 00000100:00100000:0.0:1789776576.923211:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776576.923248:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471532928 00000100:00100000:0.0:1789776576.923254:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471532928 00000100:00100000:0.0:1789776576.923290:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1789776576.923297:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa597450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+19:3276:x1876716471532928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776576.923346:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa597450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+19:3276:x1876716471532928:12345-0@lo:400:kworker.0 Request processed in 47us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776576.923353:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1789776576.923385:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471533440 00000100:00100000:0.0:1789776576.923389:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471533440 00000100:00100000:0.0:1789776576.923421:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471533056 00000100:00100000:0.0:1789776576.923424:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471533056 00000100:00100000:0.0:1789776576.923434:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471533184 00000100:00100000:0.0:1789776576.923435:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471533184 00000100:00100000:0.0:1789776576.923444:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789776576.923448:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876716471533440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776576.923479:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876716471533440:12345-0@lo:400:kworker.0 Request processed in 30us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776576.923485:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789776576.923505:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789776576.923511:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1876716471533056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776576.923538:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1876716471533056:12345-0@lo:400:kworker.0 Request processed in 28us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776576.923542:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789776576.923551:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789776576.923554:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1876716471533184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776576.923569:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1876716471533184:12345-0@lo:400:kworker.0 Request processed in 16us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776576.923573:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789776576.923583:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471533312 00000100:00100000:0.0:1789776576.923585:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471533312 00000100:00100000:0.0:1789776576.923600:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471533568 00000100:00100000:0.0:1789776576.923601:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471533568 00000100:00100000:0.0:1789776576.923612:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789776576.923616:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba3bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3276:x1876716471533312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776576.923633:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba3bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3276:x1876716471533312:12345-0@lo:400:kworker.0 Request processed in 17us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776576.923636:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789776576.923642:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789776576.923645:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471533568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776576.923657:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471533568:12345-0@lo:400:kworker.0 Request processed in 12us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776576.923661:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789776576.923691:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9de6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471533312:0@lo:400:kworker.0 00000100:00100000:0.0:1789776576.923696:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c8582a70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9db43398-240e-4f78-8778-c11d527e09a1:3276:1876716471532928:0@lo:400:kworker.0 00000100:00100000:0.0:1789776576.923709:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9de4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3276:1876716471533440:0@lo:400:kworker.0 00000100:00080000:0.0:1789776576.923727:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789776576.923731:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789776576.923759:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9de6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3273:1876716471533184:0@lo:400:kworker.0 00000100:00100000:0.0:1789776576.923768:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c8582a71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3273:1876716471533056:0@lo:400:kworker.0 00000100:00100000:0.0:1789776576.923776:0:3273:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1789776576.923781:0:3273:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c86ba374e00, transno 4294967310 00000100:00100000:0.0:1789776576.923791:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9de4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471533568:0@lo:400:kworker.0 00000001:00080000:0.0:1789776576.948946:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:0.0:1789776576.948967:0:5833:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:0.0:1789776576.948995:0:5833:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c86bf30ea80 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1789776576.949000:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c86aa269700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c86bf30eb40 00000020:00080000:0.0:1789776576.949004:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c86aa269500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c86bb58d400 00000020:00080000:0.0:1789776576.949028:0:5844:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1789776576.949165:0:5844:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:0.0:1789776576.956570:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:0.0:1789776576.956589:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000100:00100000:2.0:1789776577.428978:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86af5e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471533696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789776577.429068:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789776577.429353:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776577.429465:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471533696 00000100:00100000:0.0:1789776577.429473:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471533696 00000100:00100000:0.0:1789776577.429529:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789776577.429539:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb54ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471533696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789776577.429576:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789776577.429632:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb54ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471533696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776577.429656:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789776577.429748:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86af5e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471533696:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1789776578.004536:0:11658:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789776578.004547:0:11658:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789776578.004844:0:11658:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1789776578.004851:0:11658:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789776578.454297:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776579.361964:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776579.362021:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776579.362060:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776579.362094:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776579.362124:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776579.362156:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462115840 00000100:00100000:0.0:1789776579.362165:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462115840 00000100:00100000:0.0:1789776579.362251:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462115712 00000100:00100000:0.0:1789776579.362255:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462115712 00000100:00100000:0.0:1789776579.362279:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 95 00000100:00100000:0.0:1789776579.362289:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0795fb8a-e14a-4768-806c-f332ad101de7+5:2355:x1876716462115840:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1789776579.362363:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0795fb8a-e14a-4768-806c-f332ad101de7+5:2355:x1876716462115840:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 75us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776579.362371:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 95 00000100:00100000:0.0:1789776579.362388:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 96 00000100:00100000:0.0:1789776579.362395:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba374e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0795fb8a-e14a-4768-806c-f332ad101de7+7:2355:x1876716462115712:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1789776579.362423:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba374e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0795fb8a-e14a-4768-806c-f332ad101de7+7:2355:x1876716462115712:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 30us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776579.362429:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 96 00000100:00100000:0.0:1789776579.362447:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462115584 00000100:00100000:0.0:1789776579.362451:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462115584 00000100:00080000:1.0:1789776579.362586:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789776579.362591:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789776579.362979:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462115456 00000100:00100000:3.0:1789776579.362984:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462115456 00000100:00100000:3.0:1789776579.363030:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 297 00000100:00100000:3.0:1789776579.363038:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa594050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:2355:x1876716462115456:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1789776579.363078:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa594050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:2355:x1876716462115456:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 41us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776579.363085:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 297 00000100:00100000:1.0:1789776579.363605:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462115968 00000100:00100000:1.0:1789776579.363610:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462115968 00000100:00100000:1.0:1789776579.363635:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 164 00000100:00100000:1.0:1789776579.363646:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+18:2355:x1876716462115584:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1789776579.363665:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 165 00000100:00100000:3.0:1789776579.363676:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d27fff26-e747-430b-8151-cc0e7e6df617+5:2355:x1876716462115968:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1789776579.363831:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+18:2355:x1876716462115584:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 188us (1878us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776579.363838:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 164 00000100:00100000:3.0:1789776579.363890:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d27fff26-e747-430b-8151-cc0e7e6df617+5:2355:x1876716462115968:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 215us (1763us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776579.363899:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 165 00000100:00080000:0.0:1789776579.365568:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789776579.476441:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776580.500519:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776581.014492:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789776581.014521:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9de4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471533824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789776581.014611:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776581.014697:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471533824 00000100:00100000:3.0:1789776581.014706:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471533824 00000100:00100000:3.0:1789776581.014772:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789776581.014795:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9de6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471533824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789776581.014848:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789776581.014899:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9de6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471533824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776581.014906:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1789776581.014929:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789776581.014956:0:3276:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1789776581.014961:0:3276:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1789776581.014987:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9de4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471533824:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789776581.526914:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776581.841735:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776581.841858:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462116096 00000100:00100000:0.0:1789776581.841869:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462116096 00000100:00100000:0.0:1789776581.841977:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 238 00000100:00100000:0.0:1789776581.841989:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf34c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+18:11278:x1876716462116096:12345-192.168.202.6@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789776581.842105:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf34c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+18:11278:x1876716462116096:12345-192.168.202.6@tcp:60:lhsmtool_posix.0 Request processed in 119us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776581.842112:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 238 00000100:00080000:3.0:1789776581.842528:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789776581.844912:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776581.845256:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462116352 00000100:00100000:0.0:1789776581.845280:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462116352 00000100:00100000:0.0:1789776581.845343:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 65 00000100:00100000:0.0:1789776581.845353:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8689394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+18:11278:x1876716462116352:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789776581.845684:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8689394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+19:11278:x1876716462116352:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 Request processed in 331us (782us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1789776581.845692:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 65 00000100:00100000:2.0:1789776582.037393:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb56b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471534336:0@lo:400:kworker.0 00000100:00100000:2.0:1789776582.037468:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776582.037523:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789776582.037529:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb54ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471533952:0@lo:400:kworker.0 00000100:00100000:2.0:1789776582.037559:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776582.037582:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb568380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3275:1876716471534464:0@lo:400:kworker.0 00000100:00100000:2.0:1789776582.037608:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776582.037637:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb569880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3274:1876716471534208:0@lo:400:kworker.0 00000100:00100000:2.0:1789776582.037660:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776582.037678:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789776582.037684:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb54fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3274:1876716471534080:0@lo:400:kworker.0 00000100:00100000:2.0:1789776582.037922:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776582.037944:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb56b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471534592:0@lo:400:kworker.0 00000100:00100000:2.0:1789776582.037966:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776582.038020:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471533952 00000100:00100000:2.0:1789776582.038028:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471533952 00000100:00100000:2.0:1789776582.038071:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1789776582.038092:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa595050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+19:3275:x1876716471533952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776582.038140:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa595050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+19:3275:x1876716471533952:12345-0@lo:400:kworker.0 Request processed in 49us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776582.038147:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1789776582.038181:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471534464 00000100:00100000:2.0:1789776582.038185:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471534464 00000100:00100000:2.0:1789776582.038236:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471534208 00000100:00100000:2.0:1789776582.038239:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471534208 00000100:00100000:2.0:1789776582.038254:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471534080 00000100:00100000:2.0:1789776582.038257:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471534080 00000100:00100000:2.0:1789776582.038270:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789776582.038276:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1876716471534464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776582.038309:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1876716471534464:12345-0@lo:400:kworker.0 Request processed in 34us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776582.038316:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789776582.038327:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789776582.038334:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1876716471534208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776582.038365:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1876716471534208:12345-0@lo:400:kworker.0 Request processed in 31us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776582.038371:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789776582.038381:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789776582.038387:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1876716471534080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776582.038413:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1876716471534080:12345-0@lo:400:kworker.0 Request processed in 26us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776582.038419:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:2.0:1789776582.038695:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789776582.039127:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb54fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3274:1876716471534080:0@lo:400:kworker.0 00000100:00100000:2.0:1789776582.039154:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb569880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3274:1876716471534208:0@lo:400:kworker.0 00000100:00100000:2.0:1789776582.039524:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb54ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471533952:0@lo:400:kworker.0 00000100:00100000:2.0:1789776582.039536:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb568380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3275:1876716471534464:0@lo:400:kworker.0 00000100:00100000:2.0:1789776582.040107:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471534336 00000100:00100000:2.0:1789776582.040114:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471534336 00000100:00100000:2.0:1789776582.040180:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471534592 00000100:00100000:2.0:1789776582.040184:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471534592 00000100:00100000:2.0:1789776582.040213:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789776582.040251:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb56aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471534336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776582.040462:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789776582.040472:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471534592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776582.040547:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471534592:12345-0@lo:400:kworker.0 Request processed in 77us (2580us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776582.040554:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:3.0:1789776582.041114:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789776582.041153:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb56b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471534592:0@lo:400:kworker.0 00000100:00100000:2.0:1789776582.041376:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb56aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471534336:12345-0@lo:400:kworker.0 Request processed in 1125us (3906us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776582.041384:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789776582.042089:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb56b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471534336:0@lo:400:kworker.0 00000001:00080000:1.0:1789776582.155149:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1789776582.155167:0:5833:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1789776582.155404:0:5844:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1789776582.155416:0:5844:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:2.0:1789776582.307175:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776582.307324:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462116480 00000100:00100000:3.0:1789776582.307336:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462116480 00000100:00100000:3.0:1789776582.307431:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 239 00000100:00100000:3.0:1789776582.307441:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d27fff26-e747-430b-8151-cc0e7e6df617+5:12085:x1876716462116480:12345-192.168.202.6@tcp:101:lsof.0 00010000:00010000:3.0:1789776582.307476:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:2.0:1789776582.307593:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789776582.307626:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8f0079 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2a96 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776582.307699:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8f0080 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776582.307718:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8f0080 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776582.307732:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8f0080 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776582.307772:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789776582.307776:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789776582.307799:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8f0080 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776582.307824:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679c00/0x26940258de8f0079 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a96 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776582.307855:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8f0080 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a96 expref: 6 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776582.307865:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c86a08df700) 00010000:00010000:3.0:1789776582.307868:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789776582.307872:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8681679200, rc 0) 00000100:00100000:3.0:1789776582.307944:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d27fff26-e747-430b-8151-cc0e7e6df617+6:12085:x1876716462116480:12345-192.168.202.6@tcp:101:lsof.0 Request processed in 504us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776582.307952:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 239 00000100:00100000:3.0:1789776582.548608:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c8582a70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471534720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789776582.548711:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776582.548992:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471534720 00000100:00100000:0.0:1789776582.549001:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471534720 00000100:00100000:0.0:1789776582.549075:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789776582.549085:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9de4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471534720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789776582.549124:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789776582.549185:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9de4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471534720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776582.549193:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789776582.549355:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c8582a70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471534720:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789776582.553897:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776583.574234:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776584.483660:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776584.483714:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776584.483748:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776584.483785:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776584.483966:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462116608 00000100:00100000:2.0:1789776584.483977:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462116608 00000100:00100000:2.0:1789776584.484041:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 299 00000100:00100000:2.0:1789776584.484061:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:2357:x1876716462116608:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1789776584.484137:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:2357:x1876716462116608:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 86us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776584.484145:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 299 00000100:00100000:1.0:1789776584.484527:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462116736 00000100:00100000:1.0:1789776584.484533:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462116736 00000100:00100000:1.0:1789776584.484575:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 169 00000100:00100000:1.0:1789776584.484582:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bff62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+18:2356:x1876716462116736:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1789776584.484642:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bff62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0795fb8a-e14a-4768-806c-f332ad101de7+18:2356:x1876716462116736:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 60us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776584.484649:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 169 00000100:00100000:3.0:1789776584.484881:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462116864 00000100:00100000:3.0:1789776584.484885:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462116864 00000100:00100000:3.0:1789776584.485079:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462116992 00000100:00100000:3.0:1789776584.485084:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462116992 00000100:00100000:3.0:1789776584.485111:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 99 00000100:00100000:3.0:1789776584.485119:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8689395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+7:2357:x1876716462116864:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1789776584.485158:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8689395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+7:2357:x1876716462116864:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 40us (1444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776584.485165:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 99 00000100:00100000:3.0:1789776584.485177:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 100 00000100:00100000:3.0:1789776584.485183:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bff61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+5:2356:x1876716462116992:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1789776584.485206:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bff61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+5:2356:x1876716462116992:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 24us (1422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776584.485212:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 100 00000100:00100000:3.0:1789776584.485288:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776584.485317:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462117120 00000100:00100000:2.0:1789776584.485323:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462117120 00000100:00100000:2.0:1789776584.485365:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 170 00000100:00100000:2.0:1789776584.485375:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9de4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d27fff26-e747-430b-8151-cc0e7e6df617+6:2357:x1876716462117120:12345-192.168.202.6@tcp:400:kworker.0 00000100:00080000:3.0:1789776584.485381:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789776584.485386:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789776584.485389:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789776584.485415:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9de4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d27fff26-e747-430b-8151-cc0e7e6df617+6:2357:x1876716462117120:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 42us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776584.485423:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 170 00010000:00010000:2.0:1789776584.596565:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776585.621163:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776586.133555:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789776586.133577:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bff62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471534848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789776586.133650:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776586.133817:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471534848 00000100:00100000:1.0:1789776586.133824:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471534848 00000100:00100000:1.0:1789776586.133887:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789776586.133896:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86880cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471534848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789776586.133929:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789776586.134043:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789776586.134155:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86880cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471534848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 259us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776586.134162:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789776586.134268:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bff62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471534848:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789776586.646513:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789776586.892153:0:12741:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 20:09:45 (1789776585) 00000100:00100000:2.0:1789776587.156885:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb56b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3273:1876716471535104:0@lo:400:kworker.0 00000100:00100000:2.0:1789776587.156998:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776587.157038:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb56b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9db43398-240e-4f78-8778-c11d527e09a1:3276:1876716471534976:0@lo:400:kworker.0 00000100:00100000:2.0:1789776587.157061:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb54fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471535616:0@lo:400:kworker.0 00000100:00100000:3.0:1789776587.157087:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776587.157089:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776587.157118:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb54ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3276:1876716471535488:0@lo:400:kworker.0 00000100:00100000:2.0:1789776587.157128:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789776587.157133:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb568380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3273:1876716471535232:0@lo:400:kworker.0 00000100:00100000:3.0:1789776587.157140:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776587.157166:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471535104 00000100:00100000:3.0:1789776587.157168:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789776587.157172:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bb569880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471535360:0@lo:400:kworker.0 00000100:00100000:2.0:1789776587.157174:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471535104 00000100:00100000:3.0:1789776587.157193:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776587.157211:0:8177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471535488 00000100:00100000:2.0:1789776587.157214:0:8177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471535488 00000100:00100000:2.0:1789776587.157266:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789776587.157274:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1876716471535104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776587.157281:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471534976 00000100:00100000:3.0:1789776587.157284:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471534976 00000100:00100000:3.0:1789776587.157311:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1789776587.157317:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+19:3276:x1876716471534976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776587.157319:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1876716471535104:12345-0@lo:400:kworker.0 Request processed in 46us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776587.157326:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789776587.157351:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789776587.157354:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9db43398-240e-4f78-8778-c11d527e09a1+19:3276:x1876716471534976:12345-0@lo:400:kworker.0 Request processed in 38us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776587.157357:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9de6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876716471535488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776587.157361:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1789776587.157386:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9de6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876716471535488:12345-0@lo:400:kworker.0 Request processed in 30us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776587.157391:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789776587.157392:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471535616 00000100:00100000:3.0:1789776587.157395:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471535616 00000100:00100000:3.0:1789776587.157425:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471535360 00000100:00100000:3.0:1789776587.157428:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471535360 00000100:00100000:2.0:1789776587.157437:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789776587.157443:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471535616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776587.157448:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789776587.157454:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bff62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471535360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776587.157484:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bff62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471535360:12345-0@lo:400:kworker.0 Request processed in 30us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776587.157484:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471535616:12345-0@lo:400:kworker.0 Request processed in 41us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776587.157490:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789776587.157493:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:3.0:1789776587.157506:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789776587.157511:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789776587.157589:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb569880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471535360:0@lo:400:kworker.0 00000100:00100000:3.0:1789776587.157598:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb56b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9db43398-240e-4f78-8778-c11d527e09a1:3276:1876716471534976:0@lo:400:kworker.0 00000100:00100000:3.0:1789776587.157617:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb54ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3276:1876716471535488:0@lo:400:kworker.0 00000100:00100000:2.0:1789776587.157750:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776587.157787:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb56b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3273:1876716471535104:0@lo:400:kworker.0 00000100:00100000:2.0:1789776587.157843:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb54fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471535616:0@lo:400:kworker.0 00000100:00100000:3.0:1789776587.158003:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471535232 00000100:00100000:3.0:1789776587.158009:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471535232 00000100:00100000:3.0:1789776587.158065:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789776587.158073:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1876716471535232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776587.158124:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1876716471535232:12345-0@lo:400:kworker.0 Request processed in 53us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776587.158130:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00080000:3.0:1789776587.158148:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789776587.158618:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bb568380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3273:1876716471535232:0@lo:400:kworker.0 00000100:00100000:3.0:1789776587.668358:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471535744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789776587.668423:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776587.668660:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471535744 00000100:00100000:2.0:1789776587.668669:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471535744 00000100:00100000:2.0:1789776587.668752:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789776587.668761:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb54fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471535744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789776587.668828:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789776587.668871:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb54fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471535744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776587.668877:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789776587.669107:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471535744:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789776587.670052:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789776588.244571:0:11658:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789776588.244582:0:11658:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789776588.250065:0:11658:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1789776588.250086:0:11658:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789776588.692428:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776589.610720:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776589.610762:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776589.610804:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776589.610824:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776589.610847:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776589.613166:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462117248 00000100:00100000:0.0:1789776589.613181:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462117248 00000100:00100000:0.0:1789776589.613249:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 301 00000100:00100000:0.0:1789776589.613259:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa594c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:2357:x1876716462117248:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1789776589.613333:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa594c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:2357:x1876716462117248:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 75us (2528us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776589.613341:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 301 00000100:00100000:0.0:1789776589.613376:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462117632 00000100:00100000:0.0:1789776589.613380:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462117632 00000100:00100000:0.0:1789776589.613415:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462117504 00000100:00100000:0.0:1789776589.613418:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462117504 00000100:00100000:0.0:1789776589.613440:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 103 00000100:00100000:0.0:1789776589.613446:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb568380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+5:2357:x1876716462117632:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1789776589.613474:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb568380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+5:2357:x1876716462117632:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 29us (2712us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776589.613481:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 103 00000100:00100000:0.0:1789776589.613494:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 104 00000100:00100000:0.0:1789776589.613500:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb56b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+7:2357:x1876716462117504:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1789776589.613524:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb56b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+7:2357:x1876716462117504:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 24us (2699us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776589.613531:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 104 00000100:00100000:0.0:1789776589.613550:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462117376 00000100:00100000:0.0:1789776589.613553:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462117376 00000100:00100000:0.0:1789776589.613579:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462117760 00000100:00100000:0.0:1789776589.613582:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462117760 00000100:00100000:0.0:1789776589.613603:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 174 00000100:00100000:0.0:1789776589.613609:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb54ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+18:2357:x1876716462117376:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1789776589.613650:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb54ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+18:2357:x1876716462117376:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 41us (2937us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776589.613657:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 174 00000100:00100000:0.0:1789776589.613668:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 175 00000100:00100000:0.0:1789776589.613674:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb56b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d27fff26-e747-430b-8151-cc0e7e6df617+6:2357:x1876716462117760:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1789776589.613696:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb56b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d27fff26-e747-430b-8151-cc0e7e6df617+6:2357:x1876716462117760:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 23us (2848us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776589.613702:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 175 00000100:00080000:0.0:1789776589.613866:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789776589.613872:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789776589.613873:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789776589.716500:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776590.740879:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776591.258629:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789776591.258666:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86af5df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471535872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789776591.258739:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776591.258796:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471535872 00000100:00100000:3.0:1789776591.258807:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471535872 00000100:00100000:3.0:1789776591.258873:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789776591.258883:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471535872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789776591.258918:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789776591.258978:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471535872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776591.258986:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789776591.259101:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86af5df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471535872:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789776591.259371:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789776591.764483:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776592.079643:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776592.079813:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462118016 00000100:00100000:2.0:1789776592.079825:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462118016 00000100:00100000:2.0:1789776592.079914:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 66 00000100:00100000:2.0:1789776592.079925:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+18:12308:x1876716462118016:12345-192.168.202.6@tcp:35:umount.0 00000100:00100000:2.0:1789776592.080371:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+19:12308:x1876716462118016:12345-192.168.202.6@tcp:35:umount.0 Request processed in 447us (737us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1789776592.080946:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 66 00000100:00080000:0.0:1789776592.081103:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789776592.085691:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776592.085793:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462118272 00000100:00100000:2.0:1789776592.085804:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462118272 00000100:00100000:2.0:1789776592.085864:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 67 00000100:00100000:2.0:1789776592.085875:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+19:12308:x1876716462118272:12345-192.168.202.6@tcp:35:umount.0 00000100:00100000:2.0:1789776592.086353:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+20:12308:x1876716462118272:12345-192.168.202.6@tcp:35:umount.0 Request processed in 478us (670us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1789776592.086362:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 67 00000100:00100000:1.0:1789776592.097473:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776592.098530:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462118528 00000100:00100000:2.0:1789776592.098546:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462118528 00000100:00100000:2.0:1789776592.098632:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 68 00000100:00100000:2.0:1789776592.098644:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa27d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+20:12308:x1876716462118528:12345-192.168.202.6@tcp:35:umount.0 00000100:00100000:2.0:1789776592.098928:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa27d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0795fb8a-e14a-4768-806c-f332ad101de7+21:12308:x1876716462118528:12345-192.168.202.6@tcp:35:umount.0 Request processed in 286us (1465us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1789776592.098937:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 68 00000100:00100000:1.0:1789776592.102767:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776592.102933:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462118784 00000100:00100000:3.0:1789776592.102947:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462118784 00000100:00100000:3.0:1789776592.103020:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 69 00000100:00100000:3.0:1789776592.103036:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+21:12308:x1876716462118784:12345-192.168.202.6@tcp:35:umount.0 00000100:00100000:3.0:1789776592.104056:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0795fb8a-e14a-4768-806c-f332ad101de7+22:12308:x1876716462118784:12345-192.168.202.6@tcp:35:umount.0 Request processed in 1019us (1307us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1789776592.104067:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 69 00000100:00100000:0.0:1789776592.108383:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776592.108488:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776592.112802:0:11142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462118912 00000100:00100000:1.0:1789776592.112826:0:11142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462118912 00000100:00100000:1.0:1789776592.112921:0:11142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462119040 00000100:00100000:1.0:1789776592.112925:0:11142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462119040 00000100:00100000:1.0:1789776592.112970:0:11142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 18 00000100:00100000:1.0:1789776592.112981:0:11142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+14:2355:x1876716462118912:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776592.113004:0:11142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776592.113050:0:11142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c868afc7400/0x26940258de8ef096 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2621 expref: 14 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776592.113073:0:11142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776592.113180:0:11142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+13:2355:x1876716462118912:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 199us (4811us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776592.113189:0:11142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 18 00000100:00100000:1.0:1789776592.113211:0:11142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 19 00000100:00100000:1.0:1789776592.113250:0:11142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+12:2355:x1876716462119040:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776592.113259:0:11142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776592.113269:0:11142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c86829e0000/0x26940258de8ef05e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c25e9 expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776592.113280:0:11142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776592.113297:0:11142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+11:2355:x1876716462119040:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 81us (4816us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776592.113304:0:11142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 19 00000100:00100000:1.0:1789776592.118871:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776592.123732:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776592.125548:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462119168 00000100:00100000:0.0:1789776592.125571:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462119168 00000100:00100000:0.0:1789776592.125696:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 72 00000100:00100000:0.0:1789776592.125709:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+5:2353:x1876716462119168:12345-192.168.202.6@tcp:9:umount.0 00000020:00000080:0.0:1789776592.125766:0:6661:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x26940258de8ef3d0 00000100:00080000:0.0:1789776592.125779:0:6661:0:(import.c:65:import_set_state_nolock()) ffff9c8691410000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789776592.125839:0:6661:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1789776592.126243:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0795fb8a-e14a-4768-806c-f332ad101de7+2:2353:x1876716462119168:12345-192.168.202.6@tcp:9:umount.0 Request processed in 507us (7357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776592.126276:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 72 00010000:00010000:0.0:1789776592.126313:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789776592.126948:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789776592.133889:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462119296 00000100:00100000:1.0:1789776592.133911:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462119296 00000100:00100000:1.0:1789776592.134089:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 20 00000100:00100000:1.0:1789776592.134102:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb569880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+11:2354:x1876716462119296:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776592.134123:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776592.134152:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c86813a0800/0x26940258de8ef30c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c26ec expref: 11 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776592.134176:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776592.134431:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb569880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:2354:x1876716462119296:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 330us (10713us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776592.134440:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 20 00000100:00100000:3.0:1789776592.141033:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776592.141286:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462119680 00000100:00100000:0.0:1789776592.141300:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462119680 00000100:00100000:0.0:1789776592.141411:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 73 00000100:00100000:0.0:1789776592.141423:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0795fb8a-e14a-4768-806c-f332ad101de7+7:2353:x1876716462119680:12345-192.168.202.6@tcp:9:umount.0 00000020:00000080:0.0:1789776592.141477:0:6662:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x26940258de8ef638 00000020:00010000:0.0:1789776592.141488:0:6662:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c8689380800: total 0 00000100:00080000:0.0:1789776592.141494:0:6662:0:(import.c:65:import_set_state_nolock()) ffff9c8689380000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789776592.141798:0:6662:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1789776592.142308:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0795fb8a-e14a-4768-806c-f332ad101de7+5:2353:x1876716462119680:12345-192.168.202.6@tcp:9:umount.0 Request processed in 884us (1287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776592.142319:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 73 00000100:00080000:3.0:1789776592.143028:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00010000:1.0:1789776592.145807:0:8421:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c8689380800: total 0 00010000:00010000:1.0:1789776592.145914:0:8421:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c8689380800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1789776592.148171:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fc4cd84/0x26940258de8ef9d4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28c1 expref: 4 pid: 8384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776592.148289:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001090c1df/0x26940258de8f0072 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a8f expref: 3 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776592.148309:0:8421:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c8689380800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1789776592.148351:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776592.148355:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776592.148359:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776592.159111:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776592.159328:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462120704 00000100:00100000:0.0:1789776592.159343:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462120704 00000100:00100000:0.0:1789776592.159426:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 240 00000100:00100000:0.0:1789776592.159440:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a0b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+22:2353:x1876716462120704:12345-192.168.202.6@tcp:39:umount.0 00000020:00000080:0.0:1789776592.159489:0:5813:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x26940258de8ef06c 00000020:00010000:0.0:1789776592.159512:0:5813:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c8683e84000: total 0 00000100:00080000:0.0:1789776592.159518:0:5813:0:(import.c:65:import_set_state_nolock()) ffff9c8683e82800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789776592.159559:0:5813:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:2.0:1789776592.160068:0:8420:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c8683e84000: total 0 00010000:00010000:2.0:1789776592.160138:0:8420:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c8683e84000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1789776592.160182:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c8683789400) 00010000:00010000:2.0:1789776592.160187:0:8420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789776592.160199:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775400/0x26940258de8ef995 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28ac expref: 21 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776592.160747:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c8683789800) 00010000:00010000:2.0:1789776592.160791:0:8420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789776592.160799:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb400/0x26940258de8f0033 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a7a expref: 20 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776592.160818:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c86a08df700) 00010000:00010000:2.0:1789776592.160821:0:8420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789776592.160825:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08c00/0x26940258de8efa36 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28dd expref: 19 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776592.160839:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c8683789100) 00010000:00010000:2.0:1789776592.160841:0:8420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776592.160845:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb800/0x26940258de8ef352 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2701 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776592.160870:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c86a08df500) 00010000:00010000:2.0:1789776592.160873:0:8420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789776592.160877:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08600/0x26940258de8ef336 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c26fa expref: 17 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776592.160893:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c8683789400) 00010000:00010000:2.0:1789776592.160896:0:8420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789776592.160899:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cba00/0x26940258de8ef9bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28ba expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776592.160912:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c8683789800) 00010000:00010000:2.0:1789776592.160914:0:8420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789776592.160918:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09000/0x26940258de8f005d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a88 expref: 15 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776592.160944:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c8683789800) 00010000:00010000:2.0:1789776592.160947:0:8420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789776592.160951:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775c00/0x26940258de8eff53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a42 expref: 14 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776592.160971:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c8682cbe900) 00010000:00010000:2.0:1789776592.160973:0:8420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789776592.160978:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86bf5cb000/0x26940258de8ef693 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c27e8 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776592.161001:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:2.0:1789776592.161003:0:8420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789776592.161007:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8efa52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c28e4 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776592.161023:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:2.0:1789776592.161024:0:8420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789776592.161028:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08000/0x26940258de8efd31 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c29b6 expref: 11 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776592.161043:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c8683789400) 00010000:00010000:2.0:1789776592.161045:0:8420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789776592.161048:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678c00/0x26940258de8ef8b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2874 expref: 10 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776592.161061:0:8420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c8682cbe900) 00010000:00010000:2.0:1789776592.161063:0:8420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789776592.161075:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86829e1a00/0x26940258de8ef3a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2716 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776592.161090:0:8420:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c8683e84000, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1789776592.161115:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776592.161117:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776592.161119:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776592.161436:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a0b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0795fb8a-e14a-4768-806c-f332ad101de7+7:2353:x1876716462120704:12345-192.168.202.6@tcp:39:umount.0 Request processed in 1997us (2356us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1789776592.161449:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 240 00000100:00100000:3.0:1789776592.280637:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a0b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3273:1876716471536128:0@lo:400:kworker.0 00000100:00100000:3.0:1789776592.282190:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776592.282523:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a0b5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471536384:0@lo:400:kworker.0 00000100:00100000:0.0:1789776592.283921:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a0b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3274:1876716471536256:0@lo:400:kworker.0 00000100:00100000:2.0:1789776592.284079:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a0b58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9db43398-240e-4f78-8778-c11d527e09a1:3276:1876716471536000:0@lo:400:kworker.0 00000100:00100000:3.0:1789776592.284381:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471536640:0@lo:400:kworker.0 00000100:00100000:1.0:1789776592.296527:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776592.296653:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471536384 00000100:00100000:1.0:1789776592.296666:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471536384 00000100:00100000:1.0:1789776592.296738:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789776592.296764:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471536384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776592.296834:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471536384:12345-0@lo:400:kworker.0 Request processed in 85us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776592.296842:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789776592.296907:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a0b5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471536384:0@lo:400:kworker.0 00000100:00100000:2.0:1789776592.297361:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776592.297409:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3276:1876716471536512:0@lo:400:kworker.0 00000100:00100000:2.0:1789776592.297449:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776592.297942:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471536128 00000100:00100000:3.0:1789776592.297951:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471536128 00000100:00100000:2.0:1789776592.297969:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471536000 00000100:00100000:2.0:1789776592.297975:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471536000 00000100:00100000:3.0:1789776592.297990:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471536512 00000100:00100000:3.0:1789776592.297994:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471536512 00000100:00100000:2.0:1789776592.298030:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1789776592.298038:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789776592.298042:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa593c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+19:3276:x1876716471536000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776592.298052:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1876716471536128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776592.298106:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1876716471536128:12345-0@lo:400:kworker.0 Request processed in 58us (15923us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776592.298114:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789776592.298121:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa593c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9db43398-240e-4f78-8778-c11d527e09a1+19:3276:x1876716471536000:12345-0@lo:400:kworker.0 Request processed in 82us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776592.298129:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1789776592.298134:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789776592.298142:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876716471536512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776592.298187:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a0b58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9db43398-240e-4f78-8778-c11d527e09a1:3276:1876716471536000:0@lo:400:kworker.0 00000100:00080000:2.0:1789776592.298280:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789776592.298308:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876716471536512:12345-0@lo:400:kworker.0 Request processed in 166us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776592.298315:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789776592.298325:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776592.298349:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3276:1876716471536512:0@lo:400:kworker.0 00000100:00100000:2.0:1789776592.298360:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471536640 00000100:00100000:2.0:1789776592.298366:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471536640 00000100:00100000:3.0:1789776592.298406:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a0b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3273:1876716471536128:0@lo:400:kworker.0 00000100:00100000:2.0:1789776592.298412:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789776592.298422:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471536640:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789776592.298435:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789776592.298734:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471536640:12345-0@lo:400:kworker.0 Request processed in 276us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776592.298764:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789776592.298796:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471536640:0@lo:400:kworker.0 00000100:00100000:2.0:1789776592.298843:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776592.298869:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471536256 00000100:00100000:2.0:1789776592.298873:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471536256 00000100:00100000:2.0:1789776592.298913:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789776592.298920:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1876716471536256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776592.298956:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1876716471536256:12345-0@lo:400:kworker.0 Request processed in 37us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776592.298962:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00080000:2.0:1789776592.298977:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789776592.299316:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a0b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3274:1876716471536256:0@lo:400:kworker.0 00000001:00100000:3.0:1789776592.355728:0:6684:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0795fb8a-e14a-4768-806c-f332ad101de7 00000020:00000080:3.0:1789776592.355742:0:6684:0:(genops.c:885:class_export_put()) final put ffff9c8689380800/0795fb8a-e14a-4768-806c-f332ad101de7 00000020:00000080:3.0:1789776592.355798:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c8689380800/0795fb8a-e14a-4768-806c-f332ad101de7 for lustre-OST0000 00000020:00000080:3.0:1789776592.355861:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c8689380000 for lustre-OST0000 00000001:00100000:1.0:1789776592.380256:0:5833:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0795fb8a-e14a-4768-806c-f332ad101de7 00000001:00080000:1.0:1789776592.380283:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:1.0:1789776592.380330:0:5833:0:(genops.c:885:class_export_put()) final put ffff9c8683e84000/0795fb8a-e14a-4768-806c-f332ad101de7 00000020:00000080:3.0:1789776592.380483:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c8683e84000/0795fb8a-e14a-4768-806c-f332ad101de7 for lustre-MDT0000 00000020:00000080:3.0:1789776592.380574:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c8683e82800 for lustre-MDT0000 00010000:00010000:0.0:1789776592.788837:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776592.794333:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471536768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789776592.794474:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776592.795112:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471536768 00000100:00100000:1.0:1789776592.795125:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471536768 00000100:00100000:1.0:1789776592.795245:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789776592.795258:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471536768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789776592.795308:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789776592.795381:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471536768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776592.795388:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789776592.795938:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471536768:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789776593.812689:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776594.098505:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776594.098787:0:11142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462120832 00000100:00100000:3.0:1789776594.098803:0:11142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462120832 00000100:00100000:3.0:1789776594.098887:0:11142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 21 00000100:00100000:3.0:1789776594.098899:0:11142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+10:2356:x1876716462120832:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789776594.098918:0:11142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776594.098944:0:11142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c8680031c00/0x26940258de8ef145 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2660 expref: 10 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776594.098989:0:11142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776594.099060:0:11142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+9:2356:x1876716462120832:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 163us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776594.099069:0:11142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 21 00000100:00100000:3.0:1789776594.099189:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776594.099903:0:11143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462120960 00000100:00100000:2.0:1789776594.099913:0:11143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462120960 00000100:00100000:2.0:1789776594.099967:0:11143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 22 00000100:00100000:2.0:1789776594.099976:0:11143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+9:2354:x1876716462120960:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789776594.099990:0:11143:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776594.100004:0:11143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c8681678600/0x26940258de8ef13e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2636 expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776594.100018:0:11143:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776594.100062:0:11143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+8:2354:x1876716462120960:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 88us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776594.100086:0:11143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 22 00000100:00100000:3.0:1789776594.101538:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776594.101788:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462121088 00000100:00100000:1.0:1789776594.101799:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462121088 00000100:00100000:1.0:1789776594.101867:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 23 00000100:00100000:1.0:1789776594.101878:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+8:2356:x1876716462121088:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776594.101895:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776594.101917:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c868afc7200/0x26940258de8ef305 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c26e5 expref: 8 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776594.101936:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776594.101998:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+7:2356:x1876716462121088:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 123us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776594.102007:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 23 00000100:00100000:3.0:1789776594.116544:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776594.116657:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462121344 00000100:00100000:2.0:1789776594.116671:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462121344 00000100:00100000:2.0:1789776594.116787:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 241 00000100:00100000:2.0:1789776594.116820:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d27fff26-e747-430b-8151-cc0e7e6df617+6:2353:x1876716462121344:12345-192.168.202.6@tcp:39:umount.0 00000020:00000080:2.0:1789776594.116883:0:5812:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x26940258de8ef153 00000020:00010000:2.0:1789776594.116895:0:5812:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c86bf203000: total 0 00000100:00080000:2.0:1789776594.116902:0:5812:0:(import.c:65:import_set_state_nolock()) ffff9c86bf5f5800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789776594.116948:0:5812:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:2.0:1789776594.117478:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d27fff26-e747-430b-8151-cc0e7e6df617+5:2353:x1876716462121344:12345-192.168.202.6@tcp:39:umount.0 Request processed in 661us (950us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1789776594.117488:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 241 00000020:00010000:1.0:1789776594.117593:0:5799:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c86bf203000: total 0 00010000:00010000:1.0:1789776594.117652:0:5799:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c86bf203000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789776594.117692:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c86a08df700) 00010000:00010000:1.0:1789776594.117696:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789776594.117706:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8f0080 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2a96 expref: 4 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776594.117763:0:5799:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c86bf203000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1789776594.117777:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776594.117779:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776594.117781:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789776594.118559:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789776594.132855:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776594.138089:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462121600 00000100:00100000:0.0:1789776594.138111:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462121600 00000100:00100000:0.0:1789776594.138200:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 303 00000100:00100000:0.0:1789776594.138213:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa590850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+7:2353:x1876716462121600:12345-192.168.202.6@tcp:251:umount.0 00000020:00000080:0.0:1789776594.138314:0:5806:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x26940258de8ef049 00000020:00010000:0.0:1789776594.138328:0:5806:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c86af61d800: total 0 00000100:00080000:0.0:1789776594.138333:0:5806:0:(import.c:65:import_set_state_nolock()) ffff9c86af61c800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789776594.138474:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa590850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1af4197-a97c-41fa-81ad-cfe74d1f3bbe+3:2353:x1876716462121600:12345-192.168.202.6@tcp:251:umount.0 Request processed in 263us (5633us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776594.138483:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 303 00000020:00010000:1.0:1789776594.140686:0:8421:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c86af61d800: total 0 00010000:00010000:1.0:1789776594.140781:0:8421:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c86af61d800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789776594.140830:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c8681679800/0x26940258de8ef09d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2628 expref: 2 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776594.140851:0:8421:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c86af61d800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1789776594.140860:0:8421:0:(genops.c:885:class_export_put()) final put ffff9c86af61d800/f1af4197-a97c-41fa-81ad-cfe74d1f3bbe 00010000:00010000:1.0:1789776594.140883:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776594.140885:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776594.140887:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789776594.141062:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c86af61d800/f1af4197-a97c-41fa-81ad-cfe74d1f3bbe for MGS 00000020:00000080:0.0:1789776594.141118:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c86af61c800 for MGS 00010000:00010000:0.0:1789776594.836961:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776595.867315:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789776596.124163:0:12943:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1789776596.160686:0:12943:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1789776596.160791:0:12943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c868afc7600/0x26940258de8ef0dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef0e3 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776596.160815:0:12943:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c868afc7600/0x26940258de8ef0dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8ef0e3 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776596.160824:0:12943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c868afc7600/0x26940258de8ef0dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x26940258de8ef0e3 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776596.160832:0:12943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9c868afc7600/0x26940258de8ef0dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x26940258de8ef0e3 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776596.160912:0:12943:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789776596.160938:0:12943:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789776596.160967:0:12943:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789776596.160982:0:12943:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789776596.160992:0:12943:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789776596.161029:0:12943:0:(import.c:65:import_set_state_nolock()) ffff9c86b9607800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789776596.161161:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3272:1876716471536896:0@lo:39:umount.0 00000100:00100000:3.0:1789776596.161304:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776596.161707:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471536896 00000100:00100000:0.0:1789776596.161730:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471536896 00000100:00100000:0.0:1789776596.161833:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789776596.161845:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3272:x1876716471536896:12345-0@lo:39:umount.0 00000020:00000080:0.0:1789776596.161889:0:5811:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x26940258de8eee66 00000100:00080000:0.0:1789776596.161903:0:5811:0:(import.c:65:import_set_state_nolock()) ffff9c869892f000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789776596.164178:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776596.164205:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c868afc7600/0x26940258de8ef0dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x26940258de8ef0e3 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776596.164254:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc7600 already unused, calling callback (ffffffffc1da0c20) 10000000:00010000:2.0:1789776596.164261:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c868afc7600/0x26940258de8ef0dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x26940258de8ef0e3 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776596.164274:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c868afc7600/0x26940258de8ef0dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x26940258de8ef0e3 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776596.164282:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c868afc7600/0x26940258de8ef0dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x26940258de8ef0e3 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776596.164289:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789776596.164292:0:5798:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789776596.164296:0:5798:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789776596.164545:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c868afc7600/0x26940258de8ef0dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x26940258de8ef0e3 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776596.164555:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789776596.164605:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c868afc7600/0x26940258de8ef0dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x26940258de8ef0e3 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776596.164614:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c868afc7600/0x26940258de8ef0dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x26940258de8ef0e3 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776596.164637:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776596.164640:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776596.164643:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776596.164691:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471537024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789776596.164809:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776596.164899:0:11142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471537024 00000100:00100000:3.0:1789776596.164914:0:11142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471537024 00000100:00100000:1.0:1789776596.164987:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3272:x1876716471536896:12345-0@lo:39:umount.0 Request processed in 3142us (3681us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776596.165003:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1789776596.165019:0:5811:0:(genops.c:885:class_export_put()) final put ffff9c869892a800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:3.0:1789776596.165023:0:11142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789776596.165037:0:11142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8698809850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9db43398-240e-4f78-8778-c11d527e09a1+19:3275:x1876716471537024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789776596.165078:0:11142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776596.165099:0:11142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c8680030600/0x26940258de8ef0e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26940258de8ef0dc expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776596.165122:0:11142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776596.165193:0:11142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8698809850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9db43398-240e-4f78-8778-c11d527e09a1+18:3275:x1876716471537024:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776596.165201:0:11142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1789776596.165640:0:3272:0:(import.c:65:import_set_state_nolock()) ffff9c86b9607800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789776596.165662:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3272:1876716471536896:0@lo:39:umount.0 00000100:00100000:1.0:1789776596.165682:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471537024:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1789776596.165708:0:12943:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789776596.165725:0:12943:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789776596.165734:0:12943:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789776596.167179:0:12943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8680030800/0x26940258de8ef0ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef0f1 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776596.167198:0:12943:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8680030800/0x26940258de8ef0ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8ef0f1 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776596.167206:0:12943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8680030800/0x26940258de8ef0ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x26940258de8ef0f1 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776596.167249:0:12943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9c8680030800/0x26940258de8ef0ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x26940258de8ef0f1 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776596.169589:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776596.169618:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c8680030800/0x26940258de8ef0ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x26940258de8ef0f1 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776596.169636:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8680030800 already unused, calling callback (ffffffffc1da0c20) 10000000:00010000:2.0:1789776596.169679:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c8680030800/0x26940258de8ef0ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x26940258de8ef0f1 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776596.169697:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c8680030800/0x26940258de8ef0ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x26940258de8ef0f1 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776596.169707:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c8680030800/0x26940258de8ef0ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x26940258de8ef0f1 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776596.169724:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789776596.169729:0:5799:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00000020:00000080:3.0:1789776596.169785:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c869892a800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1789776596.169881:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c869892f000 for lustre-MDT0000 00010000:00010000:0.0:1789776596.171857:0:12943:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789776596.171948:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776596.172095:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c8680030800/0x26940258de8ef0ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x26940258de8ef0f1 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776596.172111:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789776596.172153:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c8680030800/0x26940258de8ef0ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x26940258de8ef0f1 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776596.172175:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c8680030800/0x26940258de8ef0ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x26940258de8ef0f1 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776596.172192:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776596.172194:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776596.172196:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776596.172210:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789776596.172269:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471537152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789776596.175324:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776596.175577:0:11144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471537152 00000100:00100000:3.0:1789776596.175596:0:11144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471537152 00000100:00100000:3.0:1789776596.175692:0:11144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789776596.175706:0:11144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9db43398-240e-4f78-8778-c11d527e09a1+18:3275:x1876716471537152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789776596.175731:0:11144:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776596.175753:0:11144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c868afc6400/0x26940258de8ef0f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26940258de8ef0ea expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776596.175771:0:11144:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776596.175859:0:11144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9db43398-240e-4f78-8778-c11d527e09a1+17:3275:x1876716471537152:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (3464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776596.175866:0:11144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789776596.175986:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471537152:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789776596.176130:0:12943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c86829e1000/0x26940258de8ef003 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef00a expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776596.176144:0:12943:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c86829e1000/0x26940258de8ef003 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8ef00a expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776596.176152:0:12943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c86829e1000/0x26940258de8ef003 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x26940258de8ef00a expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776596.176159:0:12943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9c86829e1000/0x26940258de8ef003 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x26940258de8ef00a expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776596.176244:0:12943:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789776596.176253:0:12943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c86829e1800/0x26940258de8ef2f7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef2fe expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776596.176261:0:12943:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c86829e1800/0x26940258de8ef2f7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8ef2fe expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776596.176292:0:12943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c86829e1800/0x26940258de8ef2f7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x26940258de8ef2fe expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776596.176300:0:12943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9c86829e1800/0x26940258de8ef2f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x26940258de8ef2fe expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776596.176728:0:8420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789776596.176737:0:8420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c86829e1000/0x26940258de8ef003 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x26940258de8ef00a expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776596.176745:0:8420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86829e1000 already unused, calling callback (ffffffffc1da0c20) 10000000:00010000:2.0:1789776596.176751:0:8420:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c86829e1000/0x26940258de8ef003 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x26940258de8ef00a expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776596.176762:0:8420:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c86829e1000/0x26940258de8ef003 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x26940258de8ef00a expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776596.176769:0:8420:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c86829e1000/0x26940258de8ef003 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x26940258de8ef00a expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776596.176776:0:8420:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1789776596.176779:0:8420:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1789776596.176782:0:8420:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1789776596.176951:0:8420:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c86829e1000/0x26940258de8ef003 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x26940258de8ef00a expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776596.176973:0:8420:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789776596.177012:0:8420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c86829e1000/0x26940258de8ef003 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x26940258de8ef00a expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776596.177106:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9db43398-240e-4f78-8778-c11d527e09a1:3273:1876716471537280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789776596.177185:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789776596.177207:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c86829e1000/0x26940258de8ef003 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x26940258de8ef00a expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776596.177309:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471537280 00000100:00100000:2.0:1789776596.177318:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471537280 00010000:00010000:3.0:1789776596.177326:0:8420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789776596.177334:0:8420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c86829e1800/0x26940258de8ef2f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x26940258de8ef2fe expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776596.177342:0:8420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86829e1800 already unused, calling callback (ffffffffc1da0c20) 10000000:00010000:3.0:1789776596.177348:0:8420:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c86829e1800/0x26940258de8ef2f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x26940258de8ef2fe expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776596.177359:0:8420:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c86829e1800/0x26940258de8ef2f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x26940258de8ef2fe expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789776596.177367:0:8420:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c86829e1800/0x26940258de8ef2f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x26940258de8ef2fe expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776596.177372:0:8420:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789776596.177375:0:8420:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1789776596.177399:0:8420:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c86829e1800/0x26940258de8ef2f7 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x26940258de8ef2fe expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776596.177405:0:8420:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789776596.177420:0:8420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c86829e1800/0x26940258de8ef2f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x26940258de8ef2fe expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776596.177428:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776596.177430:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776596.177523:0:12943:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789776596.177532:0:12943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c86829e1800/0x26940258de8ef2f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x26940258de8ef2fe expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776596.177549:0:12943:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789776596.177558:0:12943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c868afc6800/0x26940258de8eedb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8eedbe expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776596.177565:0:12943:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c868afc6800/0x26940258de8eedb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8eedbe expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776596.177573:0:12943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c868afc6800/0x26940258de8eedb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x26940258de8eedbe expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776596.177579:0:12943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9c868afc6800/0x26940258de8eedb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x26940258de8eedbe expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776596.177625:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789776596.177638:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9db43398-240e-4f78-8778-c11d527e09a1+17:3273:x1876716471537280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789776596.177657:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776596.177675:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c86829e0800/0x26940258de8ef00a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26940258de8ef003 expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776596.177695:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776596.177744:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9db43398-240e-4f78-8778-c11d527e09a1+16:3273:x1876716471537280:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776596.177753:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1789776596.177855:0:8419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789776596.177864:0:8419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c868afc6800/0x26940258de8eedb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x26940258de8eedbe expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776596.177872:0:8419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc6800 already unused, calling callback (ffffffffc1da0c20) 10000000:00010000:0.0:1789776596.177875:0:8419:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c868afc6800/0x26940258de8eedb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x26940258de8eedbe expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776596.177882:0:8419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c868afc6800/0x26940258de8eedb7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x26940258de8eedbe expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789776596.177889:0:8419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c868afc6800/0x26940258de8eedb7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x26940258de8eedbe expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789776596.177894:0:8419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1789776596.177897:0:8419:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:0.0:1789776596.177919:0:8419:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c868afc6800/0x26940258de8eedb7 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x26940258de8eedbe expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776596.177926:0:8419:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789776596.177956:0:8419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c868afc6800/0x26940258de8eedb7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x26940258de8eedbe expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776596.177966:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776596.177968:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776596.177970:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776596.177982:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789776596.177994:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9db43398-240e-4f78-8778-c11d527e09a1:3276:1876716471537536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789776596.178027:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776596.178068:0:11142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471537536 00000100:00100000:0.0:1789776596.178073:0:11142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471537536 00000100:00100000:0.0:1789776596.178118:0:11142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789776596.178125:0:11142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9db43398-240e-4f78-8778-c11d527e09a1+16:3276:x1876716471537536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789776596.178135:0:11142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776596.178144:0:11142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c8681678e00/0x26940258de8eedbe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26940258de8eedb7 expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776596.178157:0:11142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776596.178187:0:11142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9db43398-240e-4f78-8778-c11d527e09a1+15:3276:x1876716471537536:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776596.178194:0:11142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789776596.178261:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9db43398-240e-4f78-8778-c11d527e09a1:3276:1876716471537536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789776596.179315:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9db43398-240e-4f78-8778-c11d527e09a1:3274:1876716471537408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789776596.179385:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776596.179630:0:11144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471537408 00000100:00100000:0.0:1789776596.179638:0:11144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471537408 00000100:00100000:0.0:1789776596.179741:0:11144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789776596.179752:0:11144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9db43398-240e-4f78-8778-c11d527e09a1+15:3274:x1876716471537408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789776596.179765:0:11144:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776596.179781:0:11144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c86bf5cbe00/0x26940258de8ef2fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26940258de8ef2f7 expref: 15 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776596.179797:0:11144:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776596.179836:0:11144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9db43398-240e-4f78-8778-c11d527e09a1+14:3274:x1876716471537408:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776596.179843:0:11144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789776596.179922:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9db43398-240e-4f78-8778-c11d527e09a1:3274:1876716471537408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789776596.182695:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9db43398-240e-4f78-8778-c11d527e09a1:3273:1876716471537280:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789776596.183331:0:12943:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789776596.183343:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776596.183349:0:12943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c868afc6800/0x26940258de8eedb7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x26940258de8eedbe expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776596.183378:0:12943:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:1.0:1789776596.183387:0:12943:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1789776596.183407:0:12943:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1789776596.183442:0:12943:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1789776596.183447:0:12943:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1789776596.183451:0:12943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789776596.183457:0:12943:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:1.0:1789776596.183464:0:12943:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9c86af61f800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789776596.183470:0:12943:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9c86bf711800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789776596.183477:0:12943:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9c86bf203000 d27fff26-e747-430b-8151-cc0e7e6df617 192.168.202.6@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789776596.183482:0:12943:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9c86aa6399b8) has exports, disconnecting them 00000020:00080000:1.0:1789776596.183487:0:12943:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c86af61f800), last request at 1789776592 00000020:00000080:1.0:1789776596.183493:0:12943:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x26940258de8eefcb 00000100:00080000:1.0:1789776596.183515:0:12943:0:(import.c:65:import_set_state_nolock()) ffff9c86af61f000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789776596.183583:0:12943:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c86af61f800): rc 0 00010000:00010000:2.0:1789776596.183586:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789776596.183586:0:12943:0:(genops.c:885:class_export_put()) final put ffff9c86af61f800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1789776596.183614:0:12943:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c86bf711800), last request at 1789776592 00000020:00000080:1.0:1789776596.183618:0:12943:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x26940258de8eef00 00000100:00080000:1.0:1789776596.183624:0:12943:0:(import.c:65:import_set_state_nolock()) ffff9c86bf710800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789776596.183644:0:12943:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c86bf711800): rc 0 00000020:00000080:1.0:1789776596.183646:0:12943:0:(genops.c:885:class_export_put()) final put ffff9c86bf711800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1789776596.183655:0:12943:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb98c40d17ae0 00000100:00080000:1.0:1789776596.183696:0:12943:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000020:00000080:2.0:1789776596.183698:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c86af61f800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00100000:1.0:1789776596.183701:0:12943:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1789776596.183732:0:12943:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00000080:2.0:1789776596.183806:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c86bf711800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00080000:1.0:1789776596.183825:0:12943:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:00000080:2.0:1789776596.183843:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c86af61f000 for lustre-MDT0000 00000020:00000080:2.0:1789776596.183851:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c86bf710800 for lustre-MDT0000 00000100:00080000:1.0:1789776596.183853:0:12943:0:(import.c:65:import_set_state_nolock()) ffff9c86bc8e1000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1789776596.183885:0:12943:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789776596.183888:0:12943:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1789776596.183896:0:12943:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:0.0:1789776596.183905:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776596.183962:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3272:1876716471537664:0@lo:9:umount.0 00000100:00080000:1.0:1789776596.183977:0:12943:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1789776596.183993:0:12943:0:(import.c:65:import_set_state_nolock()) ffff9c86921e3800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789776596.184079:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776596.184154:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3272:1876716471537792:0@lo:9:umount.0 00000100:00100000:2.0:1789776596.184187:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776596.184297:0:8384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471537664 00000100:00100000:2.0:1789776596.184310:0:8384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471537664 00000100:00100000:2.0:1789776596.184515:0:8384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471537792 00000100:00100000:2.0:1789776596.184520:0:8384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471537792 00000100:00100000:2.0:1789776596.184561:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789776596.184571:0:8384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3272:x1876716471537664:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789776596.184626:0:8384:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x26940258de8eef4d 00000100:00080000:2.0:1789776596.184639:0:8384:0:(import.c:65:import_set_state_nolock()) ffff9c86b641e800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789776596.184698:0:8384:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1789776596.185164:0:8384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3272:x1876716471537664:12345-0@lo:9:umount.0 Request processed in 591us (1084us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776596.185174:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789776596.185200:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789776596.185212:0:8384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3272:x1876716471537792:12345-0@lo:9:umount.0 00000020:00080000:1.0:1789776596.185250:0:12943:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9c86aa6399b8) has no exports 00000020:00000080:2.0:1789776596.185263:0:8384:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x26940258de8ef03b 00000100:00080000:2.0:1789776596.185276:0:8384:0:(import.c:65:import_set_state_nolock()) ffff9c86c0246800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789776596.185303:0:8384:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:0.0:1789776596.185547:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776596.185738:0:8384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3272:x1876716471537792:12345-0@lo:9:umount.0 Request processed in 530us (1548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776596.185748:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1789776596.185817:0:3272:0:(import.c:65:import_set_state_nolock()) ffff9c86921e3800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789776596.185879:0:3272:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789776596.185959:0:3272:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789776596.185966:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3272:1876716471537792:0@lo:9:umount.0 00000100:00080000:2.0:1789776596.185985:0:3272:0:(import.c:65:import_set_state_nolock()) ffff9c86bc8e1000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789776596.186007:0:3272:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789776596.186009:0:3272:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789776596.186013:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3272:1876716471537664:0@lo:9:umount.0 00000100:00080000:2.0:1789776596.186296:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789776596.186302:0:5807:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789776596.188170:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776596.188358:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1789776596.201728:0:12943:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9c86aa6399b8) has no exports 00000020:00000080:1.0:1789776596.291136:0:12943:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x26940258de8eee12 00000020:00000080:1.0:1789776596.291155:0:12943:0:(genops.c:885:class_export_put()) final put ffff9c86af2e4800/lustre-QMT0000_UUID 00000020:01000000:1.0:1789776596.291175:0:12943:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1789776596.291342:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c86af2e4800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1789776596.291404:0:12943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789776596.291419:0:12943:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789776596.291426:0:12943:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9c86aa41cd28) has no exports 00000020:00000080:2.0:1789776596.292695:0:12943:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x26940258de8eee0b 00000020:00000080:2.0:1789776596.292709:0:12943:0:(genops.c:885:class_export_put()) final put ffff9c86903bc800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789776596.292819:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c86903bc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789776596.292836:0:12943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789776596.292850:0:12943:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789776596.292853:0:12943:0:(genops.c:885:class_export_put()) final put ffff9c86903ba800/lustre-QMT0000_UUID 00000020:00000080:2.0:1789776596.292857:0:12943:0:(genops.c:844:class_export_destroy()) destroying export ffff9c86903ba800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1789776596.292865:0:12943:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000001:00100000:2.0:1789776596.456929:0:7615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0795fb8a-e14a-4768-806c-f332ad101de7 00000020:00000080:2.0:1789776596.456944:0:7615:0:(genops.c:885:class_export_put()) final put ffff9c8691410800/0795fb8a-e14a-4768-806c-f332ad101de7 00000001:00100000:2.0:1789776596.456982:0:7615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789776596.456985:0:7615:0:(genops.c:885:class_export_put()) final put ffff9c86c0244000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789776596.457046:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c8691410800/0795fb8a-e14a-4768-806c-f332ad101de7 for lustre-OST0001 00000020:00000080:3.0:1789776596.457107:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c86c0244000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1789776596.457130:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c8691410000 for lustre-OST0001 00000020:00000080:3.0:1789776596.457134:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c86c0246800 for lustre-OST0001 00010000:00010000:0.0:1789776596.884720:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776597.396596:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3274:1876716471538176:0@lo:400:kworker.0 00000100:00100000:0.0:1789776597.396674:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776597.396757:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789776597.396767:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789776597.396791:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3274:1876716471538048:0@lo:400:kworker.0 00000100:00100000:2.0:1789776597.396797:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471537920:0@lo:400:kworker.0 00000100:00100000:0.0:1789776597.396812:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776597.396882:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471538176 00000100:00100000:0.0:1789776597.396890:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471538176 00000100:00100000:2.0:1789776597.396891:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776597.396932:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471538048 00000100:00100000:0.0:1789776597.396938:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471538048 00000100:00100000:0.0:1789776597.396976:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789776597.396984:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3274:x1876716471538176:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789776597.396998:0:5812:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789776597.397005:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471537920 00000100:00100000:2.0:1789776597.397014:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471537920 00000100:00100000:0.0:1789776597.397061:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3274:x1876716471538176:12345-0@lo:400:kworker.0 Request processed in 73us (384us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789776597.397076:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1789776597.397077:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1789776597.397093:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86aa593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+14:3275:x1876716471537920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776597.397110:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1789776597.397117:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3274:x1876716471538048:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789776597.397123:0:5812:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789776597.397180:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3274:x1876716471538048:12345-0@lo:400:kworker.0 Request processed in 58us (364us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789776597.397187:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86aa593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9db43398-240e-4f78-8778-c11d527e09a1+14:3275:x1876716471537920:12345-0@lo:400:kworker.0 Request processed in 94us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776597.397199:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1789776597.397206:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1789776597.397335:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471537920:0@lo:400:kworker.0 00000100:00080000:2.0:1789776597.397437:0:3274:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789776597.397444:0:3274:0:(import.c:65:import_set_state_nolock()) ffff9c86bf5f3800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789776597.397450:0:3274:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789776597.406398:0:3274:0:(import.c:65:import_set_state_nolock()) ffff9c86bf5f3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789776597.406411:0:3274:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 137 00000100:00080000:2.0:1789776597.406422:0:3274:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c86bf5f3800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1789776597.406464:0:3274:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c86ba6e9f80 x1876716471538304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789776597.406494:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3274:1876716471538048:0@lo:400:kworker.0 00000100:00080000:2.0:1789776597.406527:0:3274:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789776597.406531:0:3274:0:(import.c:65:import_set_state_nolock()) ffff9c86af619000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789776597.406534:0:3274:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789776597.406538:0:3274:0:(import.c:65:import_set_state_nolock()) ffff9c86af619000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789776597.406541:0:3274:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 156 00000100:00080000:2.0:1789776597.406546:0:3274:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c86af619000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1789776597.406557:0:3274:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c86ba6eb800 x1876716471538432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789776597.406566:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3274:1876716471538176:0@lo:400:kworker.0 00000100:00100000:3.0:1789776597.406852:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3272:1876716471538304:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1789776597.406925:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776597.406992:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3272:1876716471538432:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1789776597.407017:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776597.416888:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471538304 00000100:00100000:0.0:1789776597.416905:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471538304 00000100:00100000:0.0:1789776597.416972:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471538432 00000100:00100000:0.0:1789776597.416976:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471538432 00000100:00100000:0.0:1789776597.417001:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1789776597.417011:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3272:x1876716471538304:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1789776597.417033:0:5812:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789776597.423092:0:8177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1789776597.423107:0:8177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3272:x1876716471538432:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:2.0:1789776597.423130:0:8177:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789776597.423257:0:8177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3272:x1876716471538432:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 151us (16238us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789776597.423277:0:8177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:2.0:1789776597.423335:0:3272:0:(import.c:65:import_set_state_nolock()) ffff9c86af619000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789776597.423340:0:3272:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789776597.423344:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3272:1876716471538432:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1789776597.450785:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3272:x1876716471538304:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 33762us (43846us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789776597.450801:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:3.0:1789776597.452827:0:3272:0:(import.c:65:import_set_state_nolock()) ffff9c86bf5f3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789776597.452841:0:3272:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789776597.452846:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3272:1876716471538304:0@lo:38:ptlrpcd_00_01.0 00000001:00100000:2.0:1789776597.459896:0:5833:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d27fff26-e747-430b-8151-cc0e7e6df617 00000001:00080000:2.0:1789776597.459914:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1789776597.459919:0:5833:0:(genops.c:885:class_export_put()) final put ffff9c86bf203000/d27fff26-e747-430b-8151-cc0e7e6df617 00000020:00000080:1.0:1789776597.460577:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c86bf203000/d27fff26-e747-430b-8151-cc0e7e6df617 for lustre-MDT0000 00000020:00000080:1.0:1789776597.460645:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c86bf5f5800 for lustre-MDT0000 00000001:00100000:0.0:1789776597.466404:0:6684:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789776597.466549:0:6684:0:(genops.c:885:class_export_put()) final put ffff9c86b641c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789776597.466813:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c86b641c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789776597.466874:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c86b641e800 for lustre-OST0000 00010000:00010000:2.0:1789776597.910190:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789776598.356972:0:12943:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c86881339c0 - data ffff9c869d429438/ffff9c86bf5ccc00 00000020:01000000:2.0:1789776598.357114:0:12943:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c86af5700c0 - data ffff9c86a77826c0/ffff9c86aa48dc00 00000001:00000004:0.0:1789776598.363084:0:12943:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:1.0:1789776598.426322:0:12943:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789776598.426331:0:12943:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:1.0:1789776598.426346:0:12943:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789776598.426359:0:12943:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789776598.427257:0:6754:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789776598.427264:0:6754:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:3.0:1789776598.427275:0:6754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1789776598.429061:0:12943:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789776598.429069:0:12943:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:1.0:1789776598.429127:0:12943:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789776598.429131:0:12943:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1789776598.429985:0:8062:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789776598.429992:0:8062:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:2.0:1789776598.430002:0:8062:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1789776598.481055:0:12943:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x26940258de8eedda 00000020:00000080:2.0:1789776598.481068:0:12943:0:(genops.c:885:class_export_put()) final put ffff9c86916ba000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789776598.482576:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c86916ba000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789776598.482895:0:12943:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x26940258de8eedef 00000020:00000080:2.0:1789776598.482904:0:12943:0:(genops.c:885:class_export_put()) final put ffff9c86bab6a800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789776598.482959:0:12943:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1789776598.482966:0:12943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789776598.482974:0:12943:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789776598.482979:0:12943:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9c86aa638000) has no exports 00000004:01000000:2.0:1789776598.483145:0:12943:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1789776598.483153:0:12943:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x26940258de8ef02d 00000020:00000080:2.0:1789776598.483158:0:12943:0:(genops.c:885:class_export_put()) final put ffff9c86921e1800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789776598.483719:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c86bab6a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1789776598.485575:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c86921e1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1789776598.486805:0:12943:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1789776598.486821:0:12943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789776598.486852:0:12943:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789776598.486857:0:12943:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9c8692060000) has no exports 00000020:00000080:2.0:1789776598.486867:0:12943:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x26940258de8ef026 00000020:00000080:2.0:1789776598.486875:0:12943:0:(genops.c:885:class_export_put()) final put ffff9c86921e0000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1789776598.487306:0:12943:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1789776598.487312:0:12943:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789776598.487317:0:12943:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1789776598.487324:0:12943:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789776598.487326:0:12943:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789776598.487373:0:12943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789776598.487380:0:12943:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789776598.487495:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c86921e0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789776598.487507:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c86921e3800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1789776598.487513:0:8:0:(genops.c:885:class_export_put()) final put ffff9c86bf5f2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789776598.487515:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c86bf5f2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1789776598.487520:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789776598.487815:0:12943:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x26940258de8eef46 00000020:00000080:2.0:1789776598.487823:0:12943:0:(genops.c:885:class_export_put()) final put ffff9c86b6419000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789776598.487868:0:12943:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1789776598.487874:0:12943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789776598.487880:0:12943:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789776598.487883:0:12943:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9c8692064d28) has no exports 00000020:00000080:2.0:1789776598.487888:0:12943:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x26940258de8eef3f 00000020:00000080:2.0:1789776598.487891:0:12943:0:(genops.c:885:class_export_put()) final put ffff9c86bc8e3000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789776598.488190:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c86b6419000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789776598.488515:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c86bc8e3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1789776598.488890:0:12943:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1789776598.488894:0:12943:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789776598.488897:0:12943:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1789776598.488902:0:12943:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789776598.488904:0:12943:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789776598.488947:0:12943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789776598.488954:0:12943:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789776598.488988:0:12943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789776598.488991:0:12943:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789776598.488995:0:12943:0:(genops.c:885:class_export_put()) final put ffff9c86916bf000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789776598.488998:0:12943:0:(genops.c:844:class_export_destroy()) destroying export ffff9c86916bf000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1789776598.489003:0:12943:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789776598.489164:0:12943:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x26940258de8eedf6 00000020:00000080:2.0:1789776598.489181:0:12943:0:(genops.c:885:class_export_put()) final put ffff9c86bab69800/lustre-MDD0000_UUID 00000020:01000000:2.0:1789776598.489186:0:12943:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1789776598.489189:0:12943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789776598.489193:0:12943:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789776598.489196:0:12943:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9c86bab619b8) has no exports 00000020:00000080:2.0:1789776598.489249:0:12943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789776598.489254:0:12943:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1789776598.489258:0:12943:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x26940258de8eedfd 00000020:00000080:2.0:1789776598.489262:0:12943:0:(genops.c:885:class_export_put()) final put ffff9c86bab68800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1789776598.489270:0:12943:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c86c01a7000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1789776598.489273:0:12943:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c86c01a7000 3 00000020:01000004:2.0:1789776598.489276:0:12943:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c86c01a7000 from lustre-MDT0000 00000020:00000080:2.0:1789776598.489293:0:12943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789776598.489296:0:12943:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1789776598.489299:0:12943:0:(genops.c:885:class_export_put()) final put ffff9c86916bb800/lustre-MDT0000_UUID 00000020:00000080:2.0:1789776598.489301:0:12943:0:(genops.c:844:class_export_destroy()) destroying export ffff9c86916bb800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1789776598.489307:0:12943:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1789776598.489335:0:12943:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1789776598.489338:0:12943:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1789776598.489341:0:12943:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1789776598.489344:0:12943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789776598.489346:0:12943:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00000080:1.0:1789776598.489617:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c86bc8e1000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789776598.489624:0:8:0:(genops.c:885:class_export_put()) final put ffff9c86bc8e2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789776598.489632:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c86bc8e2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1789776598.489637:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789776598.489745:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c86bab69800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1789776598.489749:0:8:0:(genops.c:885:class_export_put()) final put ffff9c86916bc800/lustre-MDD0000_UUID 00000020:00000080:1.0:1789776598.489751:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c86916bc800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1789776598.489753:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1789776598.489928:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c86bab68800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:2.0:1789776598.490011:0:12943:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9c86988bd800 9db43398-240e-4f78-8778-c11d527e09a1 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789776598.490017:0:12943:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9c86aa41b370) has exports, disconnecting them 00000020:00080000:2.0:1789776598.490021:0:12943:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9c86988bd800), last request at 1789776366 00000020:00000080:2.0:1789776598.490039:0:12943:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x26940258de8eed9b 00000020:00010000:2.0:1789776598.490044:0:12943:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c86988bd800: total 0 00000100:00080000:2.0:1789776598.490048:0:12943:0:(import.c:65:import_set_state_nolock()) ffff9c86988bc800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789776598.490073:0:12943:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c86988bd800): rc 0 00000020:00080000:2.0:1789776598.490078:0:12943:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9c86aa41b370) has no exports 00000020:00010000:1.0:1789776598.490140:0:5799:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c86988bd800: total 0 00010000:00010000:1.0:1789776598.490144:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776598.490162:0:5799:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c86988bd800, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1789776598.490191:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c86bf5ca000/0x26940258de8ef0ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26940258de8ef0a4 expref: 9 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776598.490207:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c8681679a00/0x26940258de8ef0b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26940258de8ef0b2 expref: 8 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776598.490237:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c86bf5cac00/0x26940258de8ef0d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26940258de8ef0ce expref: 7 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776598.490249:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c868afc6600/0x26940258de8ef2e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26940258de8ef2db expref: 6 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776598.490259:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c868afc7a00/0x26940258de8ef0c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26940258de8ef0c0 expref: 5 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776598.490270:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c8681678200/0x26940258de8eeeb3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26940258de8eeeac expref: 4 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776598.490282:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c868afc7e00/0x26940258de8ef2f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26940258de8ef2e9 expref: 3 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776598.490306:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c8680030a00/0x26940258de8ef0ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26940258de8ef0f8 expref: 2 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776598.490317:0:5799:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c86988bd800, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1789776598.490329:0:5799:0:(genops.c:885:class_export_put()) final put ffff9c86988bd800/9db43398-240e-4f78-8778-c11d527e09a1 00010000:00010000:1.0:1789776598.490340:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776598.490341:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776598.490343:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789776598.490359:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c86988bd800/9db43398-240e-4f78-8778-c11d527e09a1 for MGS 00000020:00000080:1.0:1789776598.490384:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c86988bc800 for MGS 00000100:00100000:3.0:1789776598.491039:0:5806:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9c8691f02e00:5806] 2 exiting: rc = 0 00000100:00100000:2.0:1789776598.491193:0:5804:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9c8691f02c00:5804] 0 exiting: rc = 1 00000100:00100000:1.0:1789776598.491823:0:5805:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9c8691f03e00:5805] 1 exiting: rc = 0 00000100:00100000:3.0:1789776598.492200:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492209:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492240:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492248:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492254:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492260:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492265:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492270:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492276:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492282:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492287:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492294:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492311:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492317:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492322:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492328:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492333:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492339:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492346:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492516:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492523:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492529:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492534:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492539:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492546:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492552:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492557:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492562:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492567:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492572:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492577:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492583:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492589:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492594:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492600:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492605:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492611:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492616:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492621:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492627:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492633:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492639:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492644:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492650:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492656:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492661:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492667:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492681:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492706:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492712:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492718:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492723:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492728:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492734:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492739:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492745:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492750:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492756:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492762:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492768:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492773:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492779:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492785:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776598.492791:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1789776598.493191:0:12943:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789776598.493195:0:12943:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:3.0:1789776598.494926:0:12943:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c86c02af720 - data ffff9c86bf8ec0d8/ffff9c86af778800 00000020:01000000:3.0:1789776598.495067:0:12943:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c86916ac1e0 - data ffff9c869d443a20/ffff9c86aa54d000 00000020:00000080:3.0:1789776598.495770:0:12943:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x26940258de8eed7f 00000020:00000080:3.0:1789776598.495781:0:12943:0:(genops.c:885:class_export_put()) final put ffff9c8698918800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1789776598.495834:0:12943:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c86c01a7000 from MGS, refs=2 00000020:01000004:3.0:1789776598.495838:0:12943:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c86c01a7000 2 00000020:01000004:3.0:1789776598.495842:0:12943:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c86c01a7000 from MGS 00000020:00000080:3.0:1789776598.495864:0:12943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789776598.495871:0:12943:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1789776598.495873:0:12943:0:(genops.c:885:class_export_put()) final put ffff9c86c01a2800/MGS 00000020:00000080:3.0:1789776598.495876:0:12943:0:(genops.c:844:class_export_destroy()) destroying export ffff9c86c01a2800/MGS for MGS 00000020:01000000:3.0:1789776598.495883:0:12943:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1789776598.495943:0:12943:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1789776598.495947:0:12943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789776598.495953:0:12943:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789776598.495972:0:12943:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9c8683fda000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789776598.495979:0:12943:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9c86a01a99b8) has exports, disconnecting them 00000020:00080000:3.0:1789776598.495984:0:12943:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9c8683fda000), last request at 1789776367 00000020:00000080:3.0:1789776598.495988:0:12943:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x26940258de8eee4a 00000020:00080000:3.0:1789776598.495997:0:12943:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c8683fda000): rc 0 00000020:00000080:3.0:1789776598.496002:0:12943:0:(genops.c:885:class_export_put()) final put ffff9c8683fda000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789776598.496613:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c8698918800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789776598.499934:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c8683fda000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1789776598.503281:0:12943:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1789776598.503300:0:12943:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789776598.503305:0:12943:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789776598.503312:0:12943:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789776598.503520:0:12943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789776598.503530:0:12943:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1789776598.503537:0:12943:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c86c01a7000 1 00000020:00000080:2.0:1789776598.503543:0:12943:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x26940258de8eed71 00000020:00000080:2.0:1789776598.503552:0:12943:0:(genops.c:885:class_export_put()) final put ffff9c86c01a4800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1789776598.503557:0:12943:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1789776598.503562:0:12943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789776598.503566:0:12943:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789776598.503570:0:12943:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9c86aa4199b8) has no exports 00000020:00000080:1.0:1789776598.503839:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c86b9607800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789776598.503848:0:36:0:(genops.c:885:class_export_put()) final put ffff9c86b9605800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1789776598.503851:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c86b9605800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1789776598.503865:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1789776598.503935:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c86c01a4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789776598.537023:0:12943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789776598.537040:0:12943:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1789776598.537047:0:12943:0:(genops.c:885:class_export_put()) final put ffff9c86c01a7800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789776598.537052:0:12943:0:(genops.c:844:class_export_destroy()) destroying export ffff9c86c01a7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1789776598.537065:0:12943:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1789776598.537242:0:12943:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c86c01a1800 00000020:01000000:2.0:1789776598.537268:0:12943:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1789776598.537272:0:12943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789776598.537277:0:12943:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789776598.537282:0:12943:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9c86aa63cd28) has no exports 00000100:00100000:2.0:1789776598.537371:0:8177:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9c8683e96c00:8177] 3 exiting: rc = 0 00000100:00100000:0.0:1789776598.538585:0:5812:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9c86aa662800:5812] 1 exiting: rc = 0 00000100:00100000:2.0:1789776598.540312:0:5811:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9c86aa662e00:5811] 0 exiting: rc = 1 00000100:00100000:2.0:1789776598.540403:0:5813:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9c86aa273c00:5813] 2 exiting: rc = 0 00000100:00100000:2.0:1789776598.540479:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540488:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540494:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540500:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540506:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540512:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540517:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540537:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540542:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540548:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540553:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540559:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540564:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540570:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540575:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540581:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540587:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540593:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540599:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540605:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540610:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540616:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540622:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540628:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540634:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540639:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540645:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540651:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540656:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540661:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540666:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540672:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540678:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540819:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540844:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540851:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540858:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540864:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540871:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540877:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540882:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540887:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540900:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540905:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540911:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540916:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540923:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540929:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540935:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540942:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540948:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540953:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540958:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540964:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540970:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540975:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540982:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540988:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540994:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.540999:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.541003:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.541009:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.541016:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.541022:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.548995:0:5815:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9c86aa632400:5815] 1 exiting: rc = 0 00000100:00100000:1.0:1789776598.549167:0:5814:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9c86aa633400:5814] 0 exiting: rc = 1 00000100:00100000:2.0:1789776598.549374:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.549382:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.549555:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.549562:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.549569:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.549575:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.549581:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.549587:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.549593:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.549599:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.549604:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.549610:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.549630:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.549635:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.549640:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.549646:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.549651:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.549657:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.549662:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.549672:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.549678:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.549874:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.549881:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.549886:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.549891:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.549896:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.549902:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.549908:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.549913:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.549918:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.549922:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.549927:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.549932:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.550029:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.550035:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.550040:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.550045:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.550050:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.550055:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.550060:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.550065:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.550071:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.550076:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.550081:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.550086:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.550090:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.550096:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.550110:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.550115:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.550121:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.550127:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.550132:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.550137:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.550143:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.550148:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.550153:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.550158:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.550164:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.550169:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.550173:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.550178:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.550184:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.550189:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.550195:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.554308:0:5816:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9c86aa6e7000:5816] 0 exiting: rc = 1 00000100:00100000:2.0:1789776598.554641:0:5817:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9c86aa6e6200:5817] 1 exiting: rc = 0 00000100:00100000:2.0:1789776598.554731:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.554739:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.554755:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.554762:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.554768:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.554774:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.554781:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.554792:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.554799:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.554805:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.554813:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.554819:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.554825:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.554831:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.554838:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.554845:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.554851:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.554869:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.554877:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.554897:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.554904:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.554909:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.554916:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.554922:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.554928:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.554933:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.554948:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.554955:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.554961:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.554966:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.554974:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.554992:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.554999:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.555005:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.555012:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.555018:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.555024:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.555030:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.555036:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.555042:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.555048:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.555054:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.555060:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.555078:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.555084:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.555092:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.555098:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.555105:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.555111:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.555117:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.555123:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.555129:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.555144:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.555150:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.555156:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.555176:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.555183:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.555189:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.555195:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.555201:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.555207:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.555237:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.555244:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.555253:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568209:0:5818:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9c86aa661800:5818] 0 exiting: rc = 1 00000100:00100000:1.0:1789776598.568360:0:5819:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9c86aa661a00:5819] 1 exiting: rc = 0 00000100:00100000:1.0:1789776598.568610:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568618:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568624:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568629:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568634:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568653:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568658:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568663:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568668:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568673:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568678:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568696:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568709:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568714:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568718:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568723:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568728:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568733:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568738:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568742:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568747:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568752:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568757:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568763:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568768:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568773:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568778:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568783:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568788:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568792:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568797:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568803:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568808:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568813:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568818:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568823:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568827:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568831:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568836:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568841:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568854:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568859:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568865:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568870:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568874:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568879:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568884:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568889:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568894:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568899:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568905:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568910:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568914:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568919:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568924:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568929:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568934:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568940:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568945:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568950:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568955:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568959:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568964:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.568969:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.569666:0:5821:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9c86aa660e00:5821] 1 exiting: rc = 0 00000100:00100000:0.0:1789776598.569904:0:5820:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9c86aa661200:5820] 0 exiting: rc = 1 00000100:00100000:1.0:1789776598.570209:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570241:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570246:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570251:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570256:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570264:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570270:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570275:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570280:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570287:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570293:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570308:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570313:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570319:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570324:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570329:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570334:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570340:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570346:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570500:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570506:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570511:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570516:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570522:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570528:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570533:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570539:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570544:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570548:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570553:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570558:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570564:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570570:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570575:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570579:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570585:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570590:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570594:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570600:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570605:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570611:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570616:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570620:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570626:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570630:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570635:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570648:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570653:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570659:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570664:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570670:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570676:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570763:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570772:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570778:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570783:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570788:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570794:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570799:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570805:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570810:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570815:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570820:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.570825:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.571626:0:5823:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9c86aa553000:5823] 1 exiting: rc = 0 00000100:00100000:0.0:1789776598.571997:0:5822:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9c86aa553e00:5822] 0 exiting: rc = 1 00000100:00100000:1.0:1789776598.572327:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572334:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572339:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572344:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572361:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572367:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572372:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572377:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572382:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572511:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572518:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572522:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572527:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572532:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572538:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572543:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572549:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572567:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572572:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572578:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572583:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572588:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572594:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572600:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572605:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572609:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572614:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572619:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572625:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572630:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572635:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572640:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572645:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572650:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572654:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572659:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572664:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572669:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572674:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572679:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572695:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572710:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572715:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572720:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572724:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572729:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572734:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572739:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572744:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572748:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572754:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572759:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572772:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572778:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572783:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572787:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572793:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572798:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572803:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572809:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572814:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572818:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572823:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.572828:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789776598.573546:0:5824:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9c86aa7b5c00:5824] 0 exiting: rc = 1 00000100:00100000:2.0:1789776598.573920:0:5825:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9c86aa7b5800:5825] 1 exiting: rc = 0 00000100:00100000:2.0:1789776598.574128:0:5826:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9c86aa668400:5826] 2 exiting: rc = 0 00000100:00100000:1.0:1789776598.574262:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574270:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574290:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574298:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574304:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574309:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574316:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574322:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574328:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574334:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574341:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574490:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574500:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574505:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574511:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574517:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574522:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574529:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574535:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574541:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574547:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574553:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574559:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574577:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574583:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574589:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574609:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574615:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574621:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574627:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574632:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574638:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574644:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574650:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574657:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574664:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574670:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574675:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574680:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574771:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574776:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574782:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574788:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574793:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574799:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574804:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574811:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574816:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574822:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574828:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574851:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574859:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574864:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574870:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574877:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574883:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574889:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574895:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574910:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574920:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574926:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574933:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574942:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789776598.574959:0:12943:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789776598.581911:0:12943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789776598.581926:0:12943:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1789776598.581932:0:12943:0:(genops.c:885:class_export_put()) final put ffff9c86a25f5800/MDS_uuid 00000020:00000080:1.0:1789776598.581937:0:12943:0:(genops.c:844:class_export_destroy()) destroying export ffff9c86a25f5800/MDS_uuid for MDS 00000020:01000000:1.0:1789776598.581944:0:12943:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1789776598.582081:0:12943:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1789776598.932777:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776599.956922:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776600.982835:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789776601.776129:0:13099:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1789776601.810523:0:13099:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1789776601.810577:0:13099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c868afc6200/0x26940258de8ef0c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef0c7 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776601.810592:0:13099:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c868afc6200/0x26940258de8ef0c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8ef0c7 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776601.810600:0:13099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c868afc6200/0x26940258de8ef0c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x26940258de8ef0c7 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776601.810607:0:13099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9c868afc6200/0x26940258de8ef0c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x26940258de8ef0c7 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776601.812160:0:13099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789776601.812188:0:13099:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789776601.814041:0:13099:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789776601.814050:0:13099:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789776601.814058:0:13099:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789776601.814066:0:13099:0:(import.c:65:import_set_state_nolock()) ffff9c86bf5f3800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1789776601.814072:0:13099:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789776601.814073:0:13099:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789776601.814077:0:13099:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789776601.815815:0:13099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c868afc6e00/0x26940258de8ef0ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef0d5 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776601.815838:0:13099:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c868afc6e00/0x26940258de8ef0ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8ef0d5 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776601.821633:0:13099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c868afc6e00/0x26940258de8ef0ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x26940258de8ef0d5 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776601.821642:0:13099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9c868afc6e00/0x26940258de8ef0ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x26940258de8ef0d5 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776601.821766:0:8421:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789776601.821774:0:8421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c868afc6200/0x26940258de8ef0c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x26940258de8ef0c7 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776601.821783:0:8421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc6200 already unused, calling callback (ffffffffc1da0c20) 10000000:00010000:1.0:1789776601.821788:0:8421:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c868afc6200/0x26940258de8ef0c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x26940258de8ef0c7 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776601.821799:0:8421:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c868afc6200/0x26940258de8ef0c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x26940258de8ef0c7 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789776601.821807:0:8421:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c868afc6200/0x26940258de8ef0c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x26940258de8ef0c7 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776601.821813:0:8421:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789776601.821816:0:8421:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789776601.821819:0:8421:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789776601.822347:0:8421:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c868afc6200/0x26940258de8ef0c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x26940258de8ef0c7 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776601.822356:0:8421:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789776601.822394:0:8421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c868afc6200/0x26940258de8ef0c0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x26940258de8ef0c7 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776601.822403:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c868afc6200/0x26940258de8ef0c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x26940258de8ef0c7 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776601.822417:0:8421:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789776601.822420:0:8421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c868afc6e00/0x26940258de8ef0ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x26940258de8ef0d5 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776601.822426:0:8421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc6e00 already unused, calling callback (ffffffffc1da0c20) 10000000:00010000:0.0:1789776601.822429:0:8421:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c868afc6e00/0x26940258de8ef0ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x26940258de8ef0d5 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776601.822437:0:8421:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c868afc6e00/0x26940258de8ef0ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x26940258de8ef0d5 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789776601.822462:0:8421:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c868afc6e00/0x26940258de8ef0ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x26940258de8ef0d5 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789776601.822467:0:8421:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789776601.822469:0:8421:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1789776601.822482:0:8421:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c868afc6e00/0x26940258de8ef0ce lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x26940258de8ef0d5 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776601.822488:0:8421:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789776601.822494:0:8421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c868afc6e00/0x26940258de8ef0ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x26940258de8ef0d5 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776601.822501:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776601.822503:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776601.822505:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776601.822556:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471538560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789776601.822631:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776601.822710:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789776601.822715:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471538688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789776601.822737:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776601.822771:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471538560 00000100:00100000:2.0:1789776601.822779:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471538560 00000100:00100000:2.0:1789776601.822816:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471538688 00000100:00100000:2.0:1789776601.822819:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471538688 00000100:00100000:2.0:1789776601.822836:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789776601.822856:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3275:x1876716471538560:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789776601.822863:0:5797:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789776601 with bad export cookie 2779849450708725147 00000100:00100000:0.0:1789776601.824157:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789776601.824167:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3275:x1876716471538688:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789776601.824174:0:5796:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789776601 with bad export cookie 2779849450708725147 00000100:00100000:0.0:1789776601.824273:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3275:x1876716471538688:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (1534us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789776601.824281:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:3.0:1789776601.825387:0:13099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789776601.825398:0:13099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c868afc6e00/0x26940258de8ef0ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x26940258de8ef0d5 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776601.825442:0:13099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c86813a1200/0x26940258de8ef2e9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef2f0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776601.825450:0:13099:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c86813a1200/0x26940258de8ef2e9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8ef2f0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776601.825456:0:13099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c86813a1200/0x26940258de8ef2e9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x26940258de8ef2f0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776601.825463:0:13099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9c86813a1200/0x26940258de8ef2e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x26940258de8ef2f0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776601.825518:0:13099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789776601.825524:0:13099:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:3.0:1789776601.825529:0:13099:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1789776601.825559:0:13099:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1789776601.825564:0:13099:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1789776601.825570:0:13099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789776601.825576:0:13099:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789776601.825580:0:13099:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9c86a01ab370) has no exports 00000020:00080000:3.0:1789776601.825605:0:13099:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9c86a01ab370) has no exports 00000020:01000000:3.0:1789776601.830993:0:13099:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c86b53198a0 - data ffff9c86bf87f360/ffff9c86af7afc00 00000020:01000000:3.0:1789776601.831145:0:13099:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c8691eecde0 - data ffff9c86bf830948/ffff9c8691fbe000 00010000:00010000:0.0:1789776601.836765:0:8419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789776601.836781:0:8419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c86813a1200/0x26940258de8ef2e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x26940258de8ef2f0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776601.836793:0:8419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86813a1200 already unused, calling callback (ffffffffc1da0c20) 10000000:00010000:0.0:1789776601.836798:0:8419:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c86813a1200/0x26940258de8ef2e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x26940258de8ef2f0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776601.836831:0:8419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c86813a1200/0x26940258de8ef2e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x26940258de8ef2f0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789776601.836838:0:8419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c86813a1200/0x26940258de8ef2e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x26940258de8ef2f0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789776601.836844:0:8419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789776601.836847:0:8419:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789776601.836850:0:8419:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789776601.836892:0:8419:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c86813a1200/0x26940258de8ef2e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x26940258de8ef2f0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776601.836898:0:8419:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789776601.836935:0:8419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c86813a1200/0x26940258de8ef2e9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x26940258de8ef2f0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776601.836943:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c86813a1200/0x26940258de8ef2e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x26940258de8ef2f0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776601.837055:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776601.837634:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776601.837637:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776601.837639:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776601.838866:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9db43398-240e-4f78-8778-c11d527e09a1:3273:1876716471538816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789776601.838947:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789776601.839046:0:3275:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.106@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789776601.839051:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9c8691411000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1789776601.839055:0:3275:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:1.0:1789776601.839129:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471538816 00000100:00100000:1.0:1789776601.839137:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471538816 00000100:00100000:1.0:1789776601.839198:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789776601.839206:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c869880b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3273:x1876716471538816:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789776601.839213:0:5795:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789776601 with bad export cookie 2779849450708725147 00000100:00100000:1.0:1789776601.839291:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c869880b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3273:x1876716471538816:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (342us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789776601.839298:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1789776601.839330:0:3273:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.106@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:2.0:1789776601.853258:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3275:x1876716471538560:12345-0@lo:103:ldlm_bl.0 Request processed in 30394us (30620us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789776601.853274:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1789776601.863480:0:3275:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.106@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1789776601.863503:0:3275:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789776601.863512:0:3275:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c86b9e7b800 x1876716471538560/t0(0) o103->MGC192.168.202.106@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789776617 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776601.863527:0:3275:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c86b9e78000 x1876716471538688/t0(0) o103->MGC192.168.202.106@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789776617 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776601.863537:0:3275:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c86b9e7ad80 x1876716471538816/t0(0) o103->MGC192.168.202.106@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789776617 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789776601.863546:0:3275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789776601.863549:0:3275:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789776601.863550:0:3275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1789776601.868924:0:3273:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9c8691411000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1789776601.868957:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9db43398-240e-4f78-8778-c11d527e09a1:3273:1876716471538816:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1789776601.869074:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9c8691411000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789776601.869080:0:3275:0:(import.c:510:import_select_connection()) MGC192.168.202.106@tcp: connect to NID 0@lo last attempt 119 00000100:00080000:0.0:1789776601.869088:0:3275:0:(import.c:624:import_select_connection()) MGC192.168.202.106@tcp: import ffff9c8691411000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1789776601.869122:0:3275:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c86b9e78380 x1876716471538944/t0(0) o250->MGC192.168.202.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789776601.869178:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9db43398-240e-4f78-8778-c11d527e09a1:3272:1876716471538944:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:3.0:1789776601.869249:0:3272:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876716471538944 offset 0 length 520: 4 00000100:00100000:0.0:1789776601.869325:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471538560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789776601.869338:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9db43398-240e-4f78-8778-c11d527e09a1:3275:1876716471538688:0@lo:103:ldlm_bl.0 00100000:10000000:2.0:1789776601.910018:0:13099:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1789776601.960834:0:13099:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x26940258de8eeecf 00000020:00000080:1.0:1789776601.960857:0:13099:0:(genops.c:885:class_export_put()) final put ffff9c86b980e800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1789776601.960879:0:13099:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c86903b8800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1789776601.960883:0:13099:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c86903b8800 2 00000020:01000004:1.0:1789776601.960887:0:13099:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c86903b8800 from lustre-OST0000 00000020:00000080:1.0:1789776601.960912:0:13099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789776601.960922:0:13099:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1789776601.960925:0:13099:0:(genops.c:885:class_export_put()) final put ffff9c86b641d000/lustre-OST0000_UUID 00000020:00000080:1.0:1789776601.960928:0:13099:0:(genops.c:844:class_export_destroy()) destroying export ffff9c86b641d000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1789776601.960937:0:13099:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1789776601.960982:0:13099:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1789776601.960986:0:13099:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1789776601.960990:0:13099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789776601.960996:0:13099:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789776601.961003:0:13099:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9c86bf712800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789776601.961010:0:13099:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff9c86b9900000) has exports, disconnecting them 00000020:00080000:1.0:1789776601.961015:0:13099:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9c86bf712800), last request at 1789776384 00000020:00000080:1.0:1789776601.961019:0:13099:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x26940258de8eeef9 00000020:00080000:1.0:1789776601.961029:0:13099:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c86bf712800): rc 0 00000020:00000080:1.0:1789776601.961051:0:13099:0:(genops.c:885:class_export_put()) final put ffff9c86bf712800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789776601.962178:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c86b980e800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789776601.962197:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c86bf712800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1789776601.962254:0:13099:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1789776601.962259:0:13099:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789776601.962263:0:13099:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789776601.962269:0:13099:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789776601.962456:0:13099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789776601.962463:0:13099:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1789776601.962468:0:13099:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c86903b8800 1 00000020:00000080:0.0:1789776601.962473:0:13099:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x26940258de8eee89 00000020:00000080:0.0:1789776601.962490:0:13099:0:(genops.c:885:class_export_put()) final put ffff9c86b9809000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1789776601.962495:0:13099:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1789776601.962501:0:13099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789776601.962506:0:13099:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789776601.962509:0:13099:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9c86aa418000) has no exports 00000020:00000080:3.0:1789776601.962668:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c86bf5f3800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789776601.962686:0:36:0:(genops.c:885:class_export_put()) final put ffff9c86bf5f7800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1789776601.962688:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c86bf5f7800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1789776601.962700:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1789776601.962748:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c86b9809000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789776601.997964:0:13099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789776601.997982:0:13099:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1789776601.997988:0:13099:0:(genops.c:885:class_export_put()) final put ffff9c86903b9800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1789776601.997993:0:13099:0:(genops.c:844:class_export_destroy()) destroying export ffff9c86903b9800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1789776601.998004:0:13099:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1789776601.998166:0:13099:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c86903bd800 00000020:02000400:0.0:1789776601.998237:0:13099:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1789776602.094054:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789776602.516813:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9db43398-240e-4f78-8778-c11d527e09a1->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789776602.516824:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9db43398-240e-4f78-8778-c11d527e09a1->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789776602.516828:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789776602.516832:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789776602.516835:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c86af619000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789776602.516855:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 350 00000100:00080000:1.0:1789776602.516861:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789776602.516868:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c86af619000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1789776602.516907:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c86bf7bc700 x1876716471539072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789776602.517009:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3272:1876716471539072:0@lo:38:kworker.0 00000400:00000100:3.0:1789776602.517069:0:3272:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876716471539072 offset 0 length 520: 4 00010000:00010000:0.0:1789776603.161840:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776604.183258:0:8421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789776605.060927:0:13250:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1789776605.089165:0:13250:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1789776605.089532:0:13250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8680030400/0x26940258de8ef0a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef0ab expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776605.089547:0:13250:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8680030400/0x26940258de8ef0a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8ef0ab expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776605.089555:0:13250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8680030400/0x26940258de8ef0a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x26940258de8ef0ab expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776605.089563:0:13250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9c8680030400/0x26940258de8ef0a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x26940258de8ef0ab expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776605.089794:0:13250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789776605.089801:0:13250:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789776605.089827:0:13250:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789776605.089840:0:13250:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c86bf7bc700 x1876716471539072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789776617 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776605.089862:0:13250:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789776605.089870:0:13250:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789776605.089877:0:13250:0:(import.c:65:import_set_state_nolock()) ffff9c86af619000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1789776605.089882:0:13250:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789776605.089886:0:13250:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c86bf7bc700 x1876716471539072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789776617 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776605.089892:0:13250:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789776605.089895:0:13250:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:3.0:1789776605.089977:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3272:1876716471539072:0@lo:38:kworker.0 00010000:00010000:1.0:1789776605.090054:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776605.090062:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c8680030400/0x26940258de8ef0a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x26940258de8ef0ab expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776605.090071:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8680030400 already unused, calling callback (ffffffffc1da0c20) 10000000:00010000:1.0:1789776605.090074:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c8680030400/0x26940258de8ef0a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x26940258de8ef0ab expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776605.090083:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c8680030400/0x26940258de8ef0a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x26940258de8ef0ab expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789776605.090090:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c8680030400/0x26940258de8ef0a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x26940258de8ef0ab expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776605.090096:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789776605.090099:0:5799:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789776605.090109:0:5799:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789776605.090124:0:5799:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c8691411000 00010000:00010000:1.0:1789776605.090127:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c8680030400/0x26940258de8ef0a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x26940258de8ef0ab expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776605.090134:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c8680030400/0x26940258de8ef0a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x26940258de8ef0ab expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776605.090147:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776605.090149:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776605.090150:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776605.091087:0:13250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c868afc7800/0x26940258de8ef0b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef0b9 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776605.091101:0:13250:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c868afc7800/0x26940258de8ef0b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8ef0b9 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776605.091107:0:13250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c868afc7800/0x26940258de8ef0b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x26940258de8ef0b9 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776605.091112:0:13250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9c868afc7800/0x26940258de8ef0b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x26940258de8ef0b9 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776605.091133:0:13250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789776605.091140:0:13250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c86813a0200/0x26940258de8ef2db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8ef2e2 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776605.091158:0:13250:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c86813a0200/0x26940258de8ef2db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8ef2e2 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776605.091164:0:13250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c86813a0200/0x26940258de8ef2db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x26940258de8ef2e2 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776605.091172:0:13250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9c86813a0200/0x26940258de8ef2db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x26940258de8ef2e2 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776605.091186:0:13250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1789776605.091190:0:13250:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1789776605.091213:0:13250:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1789776605.091244:0:13250:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1789776605.091249:0:13250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789776605.091255:0:13250:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789776605.091260:0:13250:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9c86bab63370) has no exports 00000020:00080000:2.0:1789776605.091285:0:13250:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9c86bab63370) has no exports 00000020:01000000:2.0:1789776605.092926:0:13250:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c86b5319a80 - data ffff9c86a774faf8/ffff9c86ba3aa000 00000020:01000000:2.0:1789776605.093104:0:13250:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c86bf274180 - data ffff9c869d72d6c0/ffff9c86af608c00 00010000:00010000:3.0:1789776605.093526:0:8420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789776605.093537:0:8420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c868afc7800/0x26940258de8ef0b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x26940258de8ef0b9 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776605.093548:0:8420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc7800 already unused, calling callback (ffffffffc1da0c20) 10000000:00010000:3.0:1789776605.093553:0:8420:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c868afc7800/0x26940258de8ef0b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x26940258de8ef0b9 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776605.093563:0:8420:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c868afc7800/0x26940258de8ef0b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x26940258de8ef0b9 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789776605.093570:0:8420:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c868afc7800/0x26940258de8ef0b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x26940258de8ef0b9 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776605.093577:0:8420:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789776605.093580:0:8420:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1789776605.093583:0:8420:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1789776605.093600:0:8420:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c8691411000 00010000:00010000:3.0:1789776605.093604:0:8420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c868afc7800/0x26940258de8ef0b2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x26940258de8ef0b9 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776605.093613:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c868afc7800/0x26940258de8ef0b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x26940258de8ef0b9 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776605.093658:0:8420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789776605.093662:0:8420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c86813a0200/0x26940258de8ef2db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x26940258de8ef2e2 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776605.093668:0:8420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86813a0200 already unused, calling callback (ffffffffc1da0c20) 10000000:00010000:3.0:1789776605.093670:0:8420:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c86813a0200/0x26940258de8ef2db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x26940258de8ef2e2 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776605.093677:0:8420:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c86813a0200/0x26940258de8ef2db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x26940258de8ef2e2 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789776605.093683:0:8420:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c86813a0200/0x26940258de8ef2db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x26940258de8ef2e2 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776605.093688:0:8420:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789776605.093690:0:8420:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789776605.093692:0:8420:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789776605.093698:0:8420:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c8691411000 00010000:00010000:3.0:1789776605.093700:0:8420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c86813a0200/0x26940258de8ef2db lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x26940258de8ef2e2 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776605.093706:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c86813a0200/0x26940258de8ef2db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x26940258de8ef2e2 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776605.093717:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776605.093719:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776605.093721:0:8420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776605.094569:0:8419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1789776605.107339:0:13250:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789776605.132551:0:13250:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x26940258de8eef9a 00000020:00000080:2.0:1789776605.132563:0:13250:0:(genops.c:885:class_export_put()) final put ffff9c86ba49d800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1789776605.132617:0:13250:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c86af31b000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1789776605.132622:0:13250:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c86af31b000 2 00000020:01000004:2.0:1789776605.132625:0:13250:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c86af31b000 from lustre-OST0001 00000020:00000080:2.0:1789776605.132668:0:13250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789776605.132680:0:13250:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1789776605.132683:0:13250:0:(genops.c:885:class_export_put()) final put ffff9c86ba498800/lustre-OST0001_UUID 00000020:00000080:2.0:1789776605.132686:0:13250:0:(genops.c:844:class_export_destroy()) destroying export ffff9c86ba498800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1789776605.132708:0:13250:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1789776605.132839:0:13250:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 9db43398-240e-4f78-8778-c11d527e09a1->MGS 00010000:00010000:2.0:1789776605.132857:0:13250:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c868afc6000/0x26940258de8eeeac lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x26940258de8eeeb3 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776605.132869:0:13250:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c868afc6000/0x26940258de8eeeac lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x26940258de8eeeb3 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776605.132876:0:13250:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1789776605.132879:0:13250:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1789776605.132883:0:13250:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1789776605.132898:0:13250:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c8691411000 00010000:00010000:2.0:1789776605.132902:0:13250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c868afc6000/0x26940258de8eeeac lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x26940258de8eeeb3 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776605.132918:0:13250:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c868afc7c00/0x26940258de8ef0f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x26940258de8ef0ff expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776605.132925:0:13250:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c868afc7c00/0x26940258de8ef0f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x26940258de8ef0ff expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776605.132932:0:13250:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789776605.132934:0:13250:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1789776605.132935:0:13250:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1789776605.132945:0:13250:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c8691411000 00010000:00010000:2.0:1789776605.132948:0:13250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c868afc7c00/0x26940258de8ef0f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x26940258de8ef0ff expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789776605.132967:0:13250:0:(import.c:65:import_set_state_nolock()) ffff9c8691411000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1789776605.132971:0:13250:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789776605.132974:0:13250:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789776605.132982:0:13250:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789776605.132987:0:13250:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789776605.133000:0:13250:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c86b9e78380 x1876716471538944/t0(0) o250->MGC192.168.202.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789776611 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789776605.133156:0:13250:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789776605.133159:0:13250:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000020:00000080:0.0:1789776605.133200:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c86ba49d800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:3.0:1789776605.133426:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9db43398-240e-4f78-8778-c11d527e09a1:3272:1876716471538944:0@lo:250:ptlrpcd_00_02.0 10000000:01000000:2.0:1789776605.133566:0:13250:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789776605.133574:0:13250:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x26940258de8eed8d 00000020:00000080:2.0:1789776605.133580:0:13250:0:(genops.c:885:class_export_put()) final put ffff9c8691414000/9db43398-240e-4f78-8778-c11d527e09a1 00000020:01000000:2.0:1789776605.133588:0:13250:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.106@tcp (flags='') 00000020:00000080:2.0:1789776605.133592:0:13250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789776605.133597:0:13250:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.106@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789776605.133601:0:13250:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9c86aa63b370) has no exports 10000000:01000000:2.0:1789776605.133619:0:5808:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1789776605.133686:0:13250:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.106@tcp: client import never connected 00000100:00080000:2.0:1789776605.133689:0:13250:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1789776605.133691:0:13250:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789776605.133694:0:13250:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1789776605.133696:0:13250:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789776605.133725:0:13250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789776605.133730:0:13250:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.106@tcp (uuid 9db43398-240e-4f78-8778-c11d527e09a1) 00000020:01000000:2.0:1789776605.133735:0:13250:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1789776605.133738:0:13250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789776605.133742:0:13250:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789776605.133746:0:13250:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9c86af61e000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789776605.133751:0:13250:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff9c86bab64d28) has exports, disconnecting them 00000020:00080000:2.0:1789776605.133756:0:13250:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9c86af61e000), last request at 1789776404 00000020:00000080:2.0:1789776605.133760:0:13250:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x26940258de8eefc4 00000020:00080000:2.0:1789776605.133770:0:13250:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c86af61e000): rc 0 00000020:00000080:2.0:1789776605.133774:0:13250:0:(genops.c:885:class_export_put()) final put ffff9c86af61e000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1789776605.134401:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c8691414000/9db43398-240e-4f78-8778-c11d527e09a1 for MGC192.168.202.106@tcp 00000020:00000080:0.0:1789776605.134410:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c86af61e000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1789776605.134779:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c8691411000 for MGC192.168.202.106@tcp 00000020:00000080:0.0:1789776605.134790:0:36:0:(genops.c:885:class_export_put()) final put ffff9c86a25f2000/9db43398-240e-4f78-8778-c11d527e09a1 00000020:00000080:0.0:1789776605.134792:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c86a25f2000/9db43398-240e-4f78-8778-c11d527e09a1 for MGC192.168.202.106@tcp 00000020:01000000:0.0:1789776605.134797:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.106@tcp (9db43398-240e-4f78-8778-c11d527e09a1) 00010000:01000000:3.0:1789776605.135448:0:13250:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1789776605.135455:0:13250:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789776605.135459:0:13250:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789776605.135466:0:13250:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789776605.135556:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:0.0:1789776605.135701:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c86af619000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1789776605.136009:0:8421:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1789776605.136420:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:0.0:1789776605.136599:0:8420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00010000:00010000:0.0:1789776605.136754:0:8419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-5 blwis in pool) 00000100:00100000:3.0:1789776605.136918:0:5793:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9c86868b5400:5793] 0 exiting: rc = 1 00000100:00100000:0.0:1789776605.137013:0:5794:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9c86868b5e00:5794] 1 exiting: rc = 0 00000100:00100000:3.0:1789776605.137126:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.137736:0:5796:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9c8686487200:5796] 1 exiting: rc = 0 00000100:00100000:0.0:1789776605.137806:0:11143:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff9c86a094a600:11143] 4 exiting: rc = 0 00000100:00100000:0.0:1789776605.137871:0:11142:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9c86ba6dce00:11142] 3 exiting: rc = 0 00000100:00100000:3.0:1789776605.138384:0:5797:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9c8691475000:5797] 2 exiting: rc = 0 00000100:00100000:0.0:1789776605.138654:0:5795:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9c868aedd200:5795] 0 exiting: rc = 1 00000100:00100000:0.0:1789776605.142667:0:11144:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_005: service thread [ffff9c86bf339400:11144] 5 exiting: rc = 0 00000100:00100000:3.0:1789776605.147693:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147705:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147712:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147718:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147724:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147730:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147736:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147741:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147747:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147752:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147757:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147762:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147768:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147772:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147778:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147784:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147790:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147797:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147802:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147807:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147813:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147819:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147823:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147827:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147832:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147837:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147857:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147862:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147868:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147872:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147878:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147883:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147888:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147894:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147898:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147903:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147909:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147914:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147921:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147929:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147936:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147945:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147953:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147961:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147968:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147975:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147979:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147983:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147988:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147993:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.147998:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.148002:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.148007:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.148012:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.148016:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.148020:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.148025:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.148032:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.148038:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.148043:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.148048:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.148062:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.148067:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.148073:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789776605.152636:0:13250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789776605.152659:0:13250:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1789776605.152666:0:13250:0:(genops.c:885:class_export_put()) final put ffff9c86ba49a000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1789776605.152672:0:13250:0:(genops.c:844:class_export_destroy()) destroying export ffff9c86ba49a000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1789776605.152678:0:13250:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1789776605.152732:0:13250:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c86af31b000 1 00000020:00000080:3.0:1789776605.152738:0:13250:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x26940258de8eef69 00000020:00000080:3.0:1789776605.152746:0:13250:0:(genops.c:885:class_export_put()) final put ffff9c8683e84800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1789776605.152761:0:13250:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1789776605.152766:0:13250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789776605.152770:0:13250:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789776605.152774:0:13250:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9c86b99019b8) has no exports 00000020:00000080:0.0:1789776605.152883:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c8683e84800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1789776605.168094:0:13250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789776605.168117:0:13250:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1789776605.168126:0:13250:0:(genops.c:885:class_export_put()) final put ffff9c86af31e000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1789776605.168132:0:13250:0:(genops.c:844:class_export_destroy()) destroying export ffff9c86af31e000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1789776605.168142:0:13250:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1789776605.171399:0:13250:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c86af31e800 00000020:01000000:0.0:1789776605.171450:0:13250:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1789776605.171459:0:13250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789776605.171465:0:13250:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789776605.171469:0:13250:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9c86b9904d28) has no exports 00000020:00000080:0.0:1789776605.171559:0:13250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789776605.171572:0:13250:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1789776605.171576:0:13250:0:(genops.c:885:class_export_put()) final put ffff9c86b980c000/OSS_uuid 00000020:00000080:0.0:1789776605.171580:0:13250:0:(genops.c:844:class_export_destroy()) destroying export ffff9c86b980c000/OSS_uuid for OSS 00000020:01000000:0.0:1789776605.171587:0:13250:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1789776605.171693:0:6661:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9c86ba319000:6661] 1 exiting: rc = 0 00000100:00100000:0.0:1789776605.173741:0:8384:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9c86bb59b600:8384] 3 exiting: rc = 0 00000100:00080000:3.0:1789776605.173920:0:5807:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1789776605.174483:0:6659:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9c86ba319e00:6659] 0 exiting: rc = 1 00000100:00100000:3.0:1789776605.175344:0:6662:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9c86ba318200:6662] 2 exiting: rc = 0 00000100:00100000:0.0:1789776605.175662:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175674:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175683:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175689:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175695:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175700:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175705:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175709:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175714:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175738:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175743:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175749:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175755:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175760:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175765:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175770:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175776:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175782:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175790:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175797:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175802:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175808:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175813:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175818:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175823:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175830:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175835:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175840:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175846:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175851:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175856:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175862:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175870:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175877:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175882:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175887:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175892:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175898:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175903:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175909:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175913:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175919:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175923:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175928:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175942:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175947:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175952:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175958:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175963:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175968:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175974:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175978:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175983:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175988:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.175993:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.176001:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.176007:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.176013:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.176018:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.176027:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.176033:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.176038:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.176044:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.176049:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.177633:0:6664:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9c868646ea00:6664] 1 exiting: rc = 0 00000100:00100000:3.0:1789776605.177796:0:6663:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9c86ba318000:6663] 0 exiting: rc = 1 00000100:00100000:0.0:1789776605.178844:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.178853:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.178858:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.178863:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.178875:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.178880:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.178885:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.178890:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.178894:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.178899:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.178903:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.178907:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.178912:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.178917:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.178937:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.178942:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.178946:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.178951:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.178956:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.178961:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.178965:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.178971:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.178975:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.178986:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.178991:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.178996:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.179001:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.179006:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.179011:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.179016:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.179021:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.179027:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.179031:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.179038:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.179043:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.179061:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.179074:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.179080:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.179086:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.179092:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.179097:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.179102:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.179107:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.179112:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.179116:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.179120:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.179126:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.179131:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.179136:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.179148:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.179153:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.179158:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.179162:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.179167:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.179177:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.179182:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.179187:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.179191:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.179196:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.179200:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.179205:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.179209:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.179519:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.179529:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.181822:0:6667:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9c86987c6c00:6667] 2 exiting: rc = 0 00000100:00100000:3.0:1789776605.182037:0:6665:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9c86ba31b800:6665] 0 exiting: rc = 1 00000100:00100000:0.0:1789776605.183856:0:6666:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9c86987c6200:6666] 1 exiting: rc = 0 00000100:00100000:3.0:1789776605.184051:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184063:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184073:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184079:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184084:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184090:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184095:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184101:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184109:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184116:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184122:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184146:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184152:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184168:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184175:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184180:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184186:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184192:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184198:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184204:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184210:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184246:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184252:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184258:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184264:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184270:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184276:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184282:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184288:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184735:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184746:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184751:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184756:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184762:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184767:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184772:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184778:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184800:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184806:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184812:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184817:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184823:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184828:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184834:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184839:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184845:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184860:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184866:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184875:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184884:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184890:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184896:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184902:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184908:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184913:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184918:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184923:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184930:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184935:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184941:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184946:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184953:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184959:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789776605.184964:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.195714:0:6668:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9c8683ed9400:6668] 0 exiting: rc = 1 00000100:00100000:3.0:1789776605.196561:0:6669:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9c86ba31be00:6669] 1 exiting: rc = 0 00000100:00100000:0.0:1789776605.196690:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196696:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196702:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196706:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196711:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196716:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196721:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196726:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196730:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196735:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196741:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196746:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196751:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196756:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196764:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196769:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196774:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196779:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196800:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196806:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196811:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196816:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196822:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196827:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196832:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196837:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196842:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196847:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196852:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196857:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196862:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196868:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196873:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196879:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196885:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196890:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196895:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196900:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196905:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196910:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196915:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196921:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196926:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196930:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196936:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196941:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196948:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196953:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196959:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196964:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196969:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196973:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196978:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196991:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.196996:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.197001:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.197007:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.197012:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.197018:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.197023:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.197028:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.197032:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.197038:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.197052:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.198080:0:6671:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9c86b6426c00:6671] 1 exiting: rc = 0 00000100:00100000:3.0:1789776605.198475:0:6670:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9c86b6426600:6670] 0 exiting: rc = 1 00000100:00100000:0.0:1789776605.199843:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.199853:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.199861:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.199867:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.199874:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.199880:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.199887:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.199894:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.199901:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.199907:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.199914:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.199920:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.199926:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.199933:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.199962:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.199970:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.199977:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.199984:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.199990:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.199997:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.200003:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.200010:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.200016:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.200038:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.200044:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.200050:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.200072:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.200080:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.200087:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.200093:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.200100:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.200107:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.200113:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.200120:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.200127:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.200133:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.200138:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.200145:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.200167:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.200175:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.200181:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.200187:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.200193:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.200198:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.200203:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.200209:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.200248:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.200256:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.200263:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.200269:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.200290:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.200466:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.200475:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.200482:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.200488:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.200507:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.200513:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.200520:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.200534:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.200540:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.200548:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.200556:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.200563:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789776605.200569:0:13250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1789776605.222139:0:13250:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1789776624.981473:0:13868:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789776633.457944:0:14329:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789776633.457951:0:14329:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1789776633.458731:0:14329:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c8688152000 00000020:01000004:3.0:1789776633.458750:0:14329:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1789776633.458759:0:14329:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789776633.458777:0:14329:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9c86b9900000) 00000020:00000080:3.0:1789776633.458795:0:14329:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789776633.480568:0:14329:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789776633.500442:0:14329:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1789776633.500843:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 537: rc = 0 00100000:10000000:2.0:1789776633.501004:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 537: rc = 0 00100000:10000000:2.0:1789776633.501104:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 537: rc = 0 00100000:10000000:2.0:1789776633.501205:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 537: rc = 0 00100000:10000000:2.0:1789776633.501337:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 537: rc = 0 00100000:10000000:2.0:1789776633.501543:0:14329:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789776633.501615:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 537: rc = 0 00100000:10000000:2.0:1789776633.501914:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 539: rc = 0 00100000:10000000:2.0:1789776633.509087:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 771: rc = 0 00100000:10000000:2.0:1789776633.510315:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 771: rc = 0 00100000:10000000:2.0:1789776633.510889:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 664: rc = 0 00100000:10000000:2.0:1789776633.511140:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 664: rc = 0 00100000:10000000:2.0:1789776633.513755:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 664: rc = 0 00100000:10000000:2.0:1789776633.514041:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 664: rc = 0 00100000:10000000:2.0:1789776633.518267:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 664: rc = 0 00100000:10000000:2.0:1789776633.518626:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 664: rc = 0 00100000:10000000:2.0:1789776633.518895:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 664: rc = 0 00100000:10000000:2.0:1789776633.519192:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 664: rc = 0 00100000:10000000:2.0:1789776633.519491:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 664: rc = 0 00100000:10000000:2.0:1789776633.519738:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 664: rc = 0 00100000:10000000:2.0:1789776633.519999:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 664: rc = 0 00100000:10000000:2.0:1789776633.520284:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 664: rc = 0 00100000:10000000:2.0:1789776633.520710:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 784: rc = 0 00100000:10000000:2.0:1789776633.521019:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 784: rc = 0 00100000:10000000:2.0:1789776633.521303:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 784: rc = 0 00100000:10000000:3.0:1789776633.526545:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 784: rc = 0 00100000:10000000:3.0:1789776633.526854:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 784: rc = 0 00100000:10000000:3.0:1789776633.527113:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 784: rc = 0 00100000:10000000:3.0:1789776633.527481:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 784: rc = 0 00100000:10000000:3.0:1789776633.527731:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 784: rc = 0 00100000:10000000:3.0:1789776633.527990:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 784: rc = 0 00100000:10000000:3.0:1789776633.528276:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 784: rc = 0 00100000:10000000:3.0:1789776633.528565:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 784: rc = 0 00100000:10000000:3.0:1789776633.528812:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 784: rc = 0 00100000:10000000:3.0:1789776633.529050:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 784: rc = 0 00100000:10000000:3.0:1789776633.529324:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 784: rc = 0 00100000:10000000:3.0:1789776633.536546:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 784: rc = 0 00100000:10000000:3.0:1789776633.536840:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 784: rc = 0 00100000:10000000:3.0:1789776633.537092:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 784: rc = 0 00100000:10000000:3.0:1789776633.537387:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 784: rc = 0 00100000:10000000:3.0:1789776633.537657:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 784: rc = 0 00100000:10000000:3.0:1789776633.537904:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 784: rc = 0 00100000:10000000:3.0:1789776633.538170:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 784: rc = 0 00100000:10000000:3.0:1789776633.538457:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 784: rc = 0 00100000:10000000:3.0:1789776633.538738:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 784: rc = 0 00100000:10000000:3.0:1789776633.538991:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 784: rc = 0 00100000:10000000:2.0:1789776633.543968:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 784: rc = 0 00100000:10000000:2.0:1789776633.544447:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 784: rc = 0 00100000:10000000:2.0:1789776633.544717:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 784: rc = 0 00100000:10000000:2.0:1789776633.544986:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 784: rc = 0 00100000:10000000:2.0:1789776633.545280:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 784: rc = 0 00100000:10000000:2.0:1789776633.545560:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 784: rc = 0 00100000:10000000:2.0:1789776633.545791:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 784: rc = 0 00100000:10000000:2.0:1789776633.546046:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 784: rc = 0 00100000:10000000:2.0:1789776633.546452:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 395: rc = 0 00100000:10000000:2.0:1789776633.547001:0:14329:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1789776633.547188:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 391: rc = 0 00100000:10000000:2.0:1789776633.548521:0:14329:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1789776633.548630:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 391: rc = 0 00100000:10000000:2.0:1789776633.549115:0:14329:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1789776633.549193:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 391: rc = 0 00100000:10000000:2.0:1789776633.550237:0:14329:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1789776633.550314:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 772: rc = 0 00100000:10000000:2.0:1789776633.550539:0:14329:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1789776633.550609:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 772: rc = 0 00100000:10000000:2.0:1789776633.550805:0:14329:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1789776633.550888:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 772: rc = 0 00000020:00000080:2.0:1789776633.551145:0:14329:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789776633.551153:0:14329:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789776633.551165:0:14329:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x26940258de8f008e 00000020:01000004:2.0:1789776633.551173:0:14329:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789776633.551177:0:14329:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789776633.551182:0:14329:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c8688152000 from MGS 00000020:01000004:2.0:1789776633.551185:0:14329:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789776633.551195:0:14329:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9c86a01acd28) 00000020:00000080:2.0:1789776633.551204:0:14329:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789776633.551291:0:14329:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c8688152000 from MGS, refs=2 00080000:01000000:2.0:1789776633.551301:0:14329:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789776633.551307:0:14329:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x26940258de8f009c 00000100:00100000:2.0:1789776633.551403:0:14329:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789776633.551583:0:14329:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789776633.551589:0:14329:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1789776633.558778:0:14329:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1789776633.558793:0:14329:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1789776633.565698:0:14329:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789776633.565932:0:14329:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1789776633.565938:0:14329:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789776633.571177:0:14329:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789776633.571193:0:14329:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1789776633.571770:0:14329:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1789776633.571778:0:14329:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1789776633.572702:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776633.572706:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776633.572708:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776633.572933:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776633.572936:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776633.572938:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776633.573471:0:14329:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789776633.576183:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1789776633.593983:0:14329:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1789776633.594003:0:14329:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789776633.594006:0:14329:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1789776633.600208:0:14338:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789776633.600776:0:14329:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789776633.600908:0:14329:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789776633.602176:0:14329:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789776633.603612:0:14329:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789776633.605631:0:14329:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789776633.605640:0:14329:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789776633.615861:0:14329:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789776633.615877:0:14329:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789776633.616355:0:14329:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789776633.616363:0:14329:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1789776633.619321:0:14329:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789776633.619350:0:14329:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.106@tcp' 00000020:01000004:3.0:1789776633.619352:0:14329:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1789776633.619385:0:14329:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.106@tcp (typ=mgc) 00000020:00000080:3.0:1789776633.619404:0:14329:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.106@tcp (ffff9c86b9903370) 00000020:00000080:3.0:1789776633.619432:0:14329:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789776633.619514:0:14329:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c86af31c000@MGC192.168.202.106@tcp: add connection 192.168.202.106@tcp at head 00010000:00010000:3.0:1789776633.619812:0:14329:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.106@tcp-0 is initialized 00000040:01000000:3.0:1789776633.619820:0:14329:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.106@tcp ctxt 1 is initialized 00000100:00080000:1.0:1789776633.619935:0:14343:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1789776633.635914:0:14344:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789776633.636007:0:14329:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.106@tcp (uuid d8197902-2e0a-4444-a5f7-ce5e9c7a9545) 00000020:00000080:3.0:1789776633.636034:0:14329:0:(genops.c:1385:class_connect()) connect: client d8197902-2e0a-4444-a5f7-ce5e9c7a9545, cookie 0x26940258de8f00aa 00000100:00080000:3.0:1789776633.636046:0:14329:0:(import.c:510:import_select_connection()) MGC192.168.202.106@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789776633.636052:0:14329:0:(import.c:624:import_select_connection()) MGC192.168.202.106@tcp: import ffff9c86af31c000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1789776633.636090:0:14329:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c86b9e7c380 x1876716471539200/t0(0) o250->MGC192.168.202.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789776633.636122:0:14329:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import d8197902-2e0a-4444-a5f7-ce5e9c7a9545->MGS 00000020:01000004:3.0:1789776633.636181:0:14329:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789776633.636186:0:14329:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789776633.636202:0:14329:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9c86b9904d28) 00000020:00000080:3.0:1789776633.636237:0:14329:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789776633.641817:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:3272:1876716471539200:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789776633.641900:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776633.641995:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471539200 00000100:00100000:0.0:1789776633.642003:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471539200 00000100:00100000:0.0:1789776633.642038:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789776633.642046:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bae15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3272:x1876716471539200:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1789776633.642076:0:14339:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from d8197902-2e0a-4444-a5f7-ce5e9c7a9545@0@lo t0 exp 0000000000000000 cur 386 last 0 00000020:00000080:0.0:1789776633.642107:0:14339:0:(genops.c:1385:class_connect()) connect: client d8197902-2e0a-4444-a5f7-ce5e9c7a9545, cookie 0x26940258de8f00b8 00000100:00080000:0.0:1789776633.642304:0:14339:0:(import.c:65:import_set_state_nolock()) ffff9c858372e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789776633.642371:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bae15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+5:3272:x1876716471539200:12345-0@lo:250:mount.lustre.0 Request processed in 323us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776633.642379:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789776633.642443:0:3272:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.106@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789776633.642466:0:3272:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.106@tcp: connect to target with instance 0 00000100:00080000:0.0:1789776633.642475:0:3272:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.106@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789776633.642480:0:3272:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789776633.642483:0:3272:0:(import.c:65:import_set_state_nolock()) ffff9c86af31c000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789776633.642485:0:3272:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789776633.642494:0:3272:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789776633.642499:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:3272:1876716471539200:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789776633.676128:0:14329:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789776633.676969:0:14329:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789776633.676976:0:14329:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1789776633.682052:0:14329:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1789776633.682067:0:14329:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789776633.687517:0:14329:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789776633.694568:0:14329:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789776633.700408:0:14329:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789776633.700661:0:14329:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789776633.700667:0:14329:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1789776633.702041:0:14329:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1789776633.702052:0:14329:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1789776633.800816:0:14329:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789776633.801059:0:14329:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789776633.801079:0:14329:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1789776633.804391:0:14329:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1789776633.804407:0:14329:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789776633.810460:0:14329:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789776633.810668:0:14329:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789776633.810674:0:14329:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1789776633.815485:0:14329:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789776633.815874:0:14329:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1789776633.816756:0:14329:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789776633.816978:0:14329:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789776633.816986:0:14329:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789776633.819483:0:14329:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789776633.819495:0:14329:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1789776633.820989:0:14329:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789776633.821199:0:14329:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789776633.821205:0:14329:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789776633.827109:0:14329:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789776633.827129:0:14329:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789776633.851500:0:14329:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789776633.851829:0:14329:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789776633.851835:0:14329:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789776633.853086:0:14329:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789776633.853097:0:14329:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789776633.853888:0:14329:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789776633.853896:0:14329:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1789776633.855181:0:14329:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1789776633.855203:0:14329:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1789776633.855210:0:14329:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.106@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1789776633.855501:0:14329:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.106@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789776633.855538:0:14329:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.106@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1789776633.855543:0:14329:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789776633.855544:0:14329:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789776633.855545:0:14329:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789776633.855546:0:14329:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789776633.855548:0:14329:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789776633.855549:0:14329:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789776633.855550:0:14329:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789776633.855552:0:14329:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789776633.855553:0:14329:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789776633.855559:0:14329:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789776633.855562:0:14329:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1789776633.855563:0:14329:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789776633.855564:0:14329:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789776633.855565:0:14329:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789776633.855566:0:14329:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789776633.855567:0:14329:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789776633.855568:0:14329:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789776633.855569:0:14329:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789776633.855570:0:14329:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789776633.855571:0:14329:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789776633.855572:0:14329:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789776633.855602:0:14329:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789776633.855622:0:14329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14329:1876716471539328:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789776633.855701:0:14329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776633.855751:0:14329:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86903e60c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776633.857023:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471539328 00000100:00100000:1.0:1789776633.857053:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471539328 00000100:00100000:1.0:1789776633.857136:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789776633.857150:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bae14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+5:14329:x1876716471539328:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789776633.857257:0:14342:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789776633.857262:0:14342:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789776633.857265:0:14342:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1789776633.857759:0:14363:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789776633.861762:0:14342:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1789776633.863960:0:14364:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1789776633.863966:0:14364:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1789776633.863968:0:14364:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1789776633.863992:0:14364:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1789776633.864446:0:14342:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789776633.864459:0:14342:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789776633.874246:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bae14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+5:14329:x1876716471539328:12345-0@lo:253:mount.lustre.0 Request processed in 17071us (18516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776633.874261:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789776633.874740:0:14329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14329:1876716471539328:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789776633.874757:0:14329:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789776633.874760:0:14329:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789776633.874762:0:14329:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789776633.874763:0:14329:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789776633.874765:0:14329:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789776633.874766:0:14329:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789776633.874767:0:14329:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789776633.874768:0:14329:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789776633.874770:0:14329:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789776633.874771:0:14329:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789776633.874773:0:14329:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789776633.874793:0:14329:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c8688152000 from lustre-MDT0000 10000000:01000000:2.0:1789776633.874819:0:14329:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1789776633.874822:0:14329:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789776633.874826:0:14329:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9c86b9903370 10000000:01000000:2.0:1789776633.874845:0:14329:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789776633.874854:0:14329:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c86b9903370 from 1 10000000:01000000:2.0:1789776633.874857:0:14329:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789776633.874900:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8686775a00/0x26940258de8f00bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776633.874910:0:14329:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c8686775a00/0x26940258de8f00bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776633.874920:0:14329:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c8686775a00/0x26940258de8f00bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776633.874941:0:14329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14329:1876716471539456:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789776633.874985:0:14329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776633.875071:0:14329:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86903e6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776633.875378:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471539456 00000100:00100000:0.0:1789776633.875385:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471539456 00000100:00100000:0.0:1789776633.875480:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789776633.875490:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bae17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+5:14329:x1876716471539456:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789776633.875503:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776633.875520:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c86b9b09000/0x26940258de8f00c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8f00bf expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776633.875542:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c86b9b09000/0x26940258de8f00c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8f00bf expref: 6 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776633.875566:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c86b9b09000/0x26940258de8f00c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8f00bf expref: 6 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776633.875574:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86b9b09000, rc 0) 00000100:00100000:0.0:1789776633.875789:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bae17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+6:14329:x1876716471539456:12345-0@lo:101:mount.lustre.0 Request processed in 300us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776633.875796:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789776633.875887:0:14329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14329:1876716471539456:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789776633.875902:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c8686775a00/0x26940258de8f00bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f00c6 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776633.875920:0:14329:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c8686775a00/0x26940258de8f00bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8f00c6 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776633.875971:0:14329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14329:1876716471539584:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789776633.876074:0:14329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776633.876140:0:14329:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8681359e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789776633.876188:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471539584 00000100:00100000:0.0:1789776633.876194:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471539584 00000100:00100000:0.0:1789776633.876242:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789776633.876249:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bae14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+6:14329:x1876716471539584:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789776633.876655:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bae14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+6:14329:x1876716471539584:12345-0@lo:501:mount.lustre.0 Request processed in 406us (580us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789776633.876662:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789776633.881293:0:14329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14329:1876716471539584:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789776633.881616:0:14329:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789776633.881632:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8686775a00/0x26940258de8f00bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f00c6 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776633.881642:0:14329:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c8686775a00/0x26940258de8f00bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f00c6 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776633.881651:0:14329:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c8688152000 10000000:01000000:2.0:1789776633.881659:0:14329:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789776633.881664:0:14329:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c8688152000 10000000:01000000:2.0:1789776633.881667:0:14329:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789776633.881669:0:14329:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9c8688152000 from 1 10000000:01000000:2.0:1789776633.881672:0:14329:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789776633.881708:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8686774800/0x26940258de8f00cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776633.881734:0:14329:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c8686774800/0x26940258de8f00cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776633.881743:0:14329:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c8686774800/0x26940258de8f00cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776633.881764:0:14329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14329:1876716471539712:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789776633.881824:0:14329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776633.881867:0:14329:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86903e6540 going to sleep for 11 seconds 00000100:00100000:1.0:1789776633.881922:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471539712 00000100:00100000:1.0:1789776633.881929:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471539712 00000100:00100000:1.0:1789776633.881986:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789776633.882005:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bae15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+6:14329:x1876716471539712:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789776633.882018:0:14339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776633.882033:0:14339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c86bf5cb000/0x26940258de8f00d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8f00cd expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776633.882053:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c86bf5cb000/0x26940258de8f00d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8f00cd expref: 7 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776633.882062:0:14339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c86bf5cb000/0x26940258de8f00d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8f00cd expref: 7 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776633.882070:0:14339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86bf5cb000, rc 0) 00000100:00100000:1.0:1789776633.882122:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bae15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+7:14329:x1876716471539712:12345-0@lo:101:mount.lustre.0 Request processed in 127us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776633.882128:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789776633.882276:0:14329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14329:1876716471539712:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789776633.882290:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c8686774800/0x26940258de8f00cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f00d4 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776633.882298:0:14329:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c8686774800/0x26940258de8f00cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8f00d4 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776633.882312:0:14329:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789776633.882316:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8686774800/0x26940258de8f00cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f00d4 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776633.882322:0:14329:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c8686774800/0x26940258de8f00cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f00d4 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776633.882327:0:14329:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789776633.882332:0:14329:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789776633.882337:0:14329:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c8688152000 10000000:01000000:3.0:1789776633.882339:0:14329:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789776633.882342:0:14329:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789776633.882352:0:14329:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789776633.882383:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8681678000/0x26940258de8f00db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776633.882390:0:14329:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c8681678000/0x26940258de8f00db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776633.882397:0:14329:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c8681678000/0x26940258de8f00db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776633.882410:0:14329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14329:1876716471539840:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789776633.882469:0:14329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776633.882495:0:14329:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8681359e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789776633.882651:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471539840 00000100:00100000:2.0:1789776633.882656:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471539840 00000100:00100000:2.0:1789776633.882681:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789776633.882688:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bae14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+7:14329:x1876716471539840:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789776633.882695:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776633.882709:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c8686774400/0x26940258de8f00e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8f00db expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776633.882723:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c8686774400/0x26940258de8f00e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8f00db expref: 8 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776633.882731:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c8686774400/0x26940258de8f00e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8f00db expref: 8 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776633.882737:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8686774400, rc 0) 00000100:00100000:2.0:1789776633.882766:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bae14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+8:14329:x1876716471539840:12345-0@lo:101:mount.lustre.0 Request processed in 78us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776633.882772:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789776633.883205:0:14329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14329:1876716471539840:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789776633.883249:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c8681678000/0x26940258de8f00db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f00e2 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776633.883258:0:14329:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c8681678000/0x26940258de8f00db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8f00e2 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776633.883313:0:14329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14329:1876716471539968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789776633.883344:0:14329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776633.883363:0:14329:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8681359e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789776633.883509:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471539968 00000100:00100000:2.0:1789776633.883514:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471539968 00000100:00100000:2.0:1789776633.883546:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789776633.883553:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bae17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+8:14329:x1876716471539968:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789776633.883957:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bae17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+9:14329:x1876716471539968:12345-0@lo:501:mount.lustre.0 Request processed in 403us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776633.883964:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789776633.884137:0:14329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14329:1876716471539968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789776633.884168:0:14329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14329:1876716471540096:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789776633.884208:0:14329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776633.884262:0:14329:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8681359e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789776633.884322:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471540096 00000100:00100000:0.0:1789776633.884328:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471540096 00000100:00100000:0.0:1789776633.884358:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789776633.884366:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+9:14329:x1876716471540096:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789776633.884686:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+9:14329:x1876716471540096:12345-0@lo:503:mount.lustre.0 Request processed in 320us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776633.884693:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789776633.884855:0:14329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14329:1876716471540096:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789776633.887468:0:14365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6ea680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14365:1876716471540224:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789776633.887560:0:14365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776633.887642:0:14365:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86903e69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776633.887687:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471540224 00000100:00100000:0.0:1789776633.887695:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471540224 00000100:00100000:0.0:1789776633.887775:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789776633.887785:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+9:14365:x1876716471540224:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789776633.888268:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+9:14365:x1876716471540224:12345-0@lo:502:llog_process_th.0 Request processed in 484us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776633.888283:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789776633.888518:0:14365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6ea680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14365:1876716471540224:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789776633.888551:0:14365:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789776633.888562:0:14365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776633.888564:0:14365:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789776633.888570:0:14365:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789776633.888573:0:14365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789776633.888587:0:14365:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9c86b99019b8) 00000020:00000080:3.0:1789776633.888606:0:14365:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789776633.888612:0:14365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789776633.888690:0:14365:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789776633.888698:0:14365:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x26940258de8f00f0 00000020:00000080:3.0:1789776633.888906:0:14365:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789776633.888911:0:14365:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789776633.888915:0:14365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776633.888916:0:14365:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789776633.888918:0:14365:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789776633.888922:0:14365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776633.888923:0:14365:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789776633.888926:0:14365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789776633.888941:0:14365:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9c86af8d99b8) 00000020:00000080:3.0:1789776633.888952:0:14365:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789776633.888957:0:14365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789776633.888959:0:14365:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789776633.888962:0:14365:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789776633.888967:0:14365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789776633.889083:0:14365:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c8688152000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789776633.889098:0:14365:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9c86af8db370) 00000020:00000080:3.0:1789776633.889106:0:14365:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789776633.889167:0:14365:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789776633.889174:0:14365:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x26940258de8f0105 00000020:00000080:3.0:1789776633.889298:0:14365:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789776633.889312:0:14365:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789776633.889317:0:14365:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x26940258de8f010c 00080000:01000000:3.0:1789776633.889322:0:14365:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789776633.889328:0:14365:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x26940258de8f0113 00010000:00010000:3.0:1789776633.993448:0:14365:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1789776633.993911:0:14365:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1789776633.994110:0:14365:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789776633.994656:0:14365:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9c86af8dcd28) 00000020:00000080:3.0:1789776633.994677:0:14365:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789776633.994733:0:14365:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789776633.994741:0:14365:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x26940258de8f0121 00000020:00000080:2.0:1789776633.996311:0:14365:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789776634.004208:0:14365:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x26940258de8f0128 00000020:00000080:2.0:1789776634.011116:0:14365:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1789776634.011133:0:14365:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789776634.011144:0:14365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776634.011146:0:14365:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1789776634.011151:0:14365:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789776634.011157:0:14365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776634.011159:0:14365:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1789776634.011163:0:14365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789776634.011211:0:14365:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1789776634.011245:0:14365:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789776634.011249:0:14365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776634.011250:0:14365:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1789776634.011252:0:14365:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789776634.011254:0:14365:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1789776634.011256:0:14365:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789776634.011258:0:14365:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789776634.011260:0:14365:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789776634.011262:0:14365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776634.011270:0:14365:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789776634.011274:0:14365:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789776634.011278:0:14365:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789776634.011281:0:14365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776634.011282:0:14365:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789776634.011286:0:14365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789776634.011291:0:14365:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.106@tcp to nid 0x20000c0a8ca6a (192.168.202.106@tcp) 00000020:01000000:2.0:1789776634.011320:0:14365:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789776634.011323:0:14365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789776634.011339:0:14365:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9c86a01a8000) 00000020:00000080:2.0:1789776634.011358:0:14365:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1789776634.011363:0:14365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789776634.012498:0:14365:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1789776634.012507:0:14365:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789776634.012519:0:14365:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x26940258de8f0136 00010000:00080000:2.0:1789776634.012631:0:14365:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c86af405800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.106@tcp at head 00010000:00010000:2.0:1789776634.012903:0:14365:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1789776634.015827:0:14365:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789776634.015883:0:14365:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789776634.026358:0:14365:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789776634.026470:0:14365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1789776634.026796:0:14365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1789776634.027280:0:14369:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789776634.027286:0:14369:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789776634.027896:0:14365:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789776634.027909:0:14365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789776634.027939:0:14365:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789776634.027958:0:14365:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x26940258de8f013d 00000100:00080000:2.0:1789776634.027969:0:14365:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789776634.027975:0:14365:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c86af405800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1789776634.028012:0:14365:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c86ba6e8380 x1876716471540352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789776634.028050:0:14365:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1789776634.028098:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3272:1876716471540352:0@lo:8:llog_process_th.0 00000020:01000000:2.0:1789776634.028117:0:14365:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789776634.028121:0:14365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776634.028124:0:14365:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789776634.028126:0:14365:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789776634.028129:0:14365:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1789776634.028130:0:14365:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789776634.028132:0:14365:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789776634.028133:0:14365:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789776634.028135:0:14365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776634.028136:0:14365:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789776634.028138:0:14365:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789776634.028141:0:14365:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789776634.028144:0:14365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776634.028145:0:14365:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789776634.028148:0:14365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789776634.028151:0:14365:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.106@tcp to nid 0x20000c0a8ca6a (192.168.202.106@tcp) 00000400:00000100:0.0:1789776634.028153:0:3272:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876716471540352 offset 0 length 520: 4 00000020:01000000:2.0:1789776634.028170:0:14365:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789776634.028172:0:14365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789776634.028183:0:14365:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9c86a01ab370) 00000020:00000080:2.0:1789776634.028194:0:14365:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1789776634.028197:0:14365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789776634.028272:0:14365:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1789776634.028278:0:14365:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:2.0:1789776634.028288:0:14365:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x26940258de8f014b 00010000:00080000:2.0:1789776634.028332:0:14365:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c86b39ca800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.106@tcp at head 00010000:00010000:2.0:1789776634.028538:0:14365:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1789776634.028713:0:14365:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789776634.028734:0:14365:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789776634.029428:0:14365:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789776634.029506:0:14365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1789776634.029598:0:14365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1789776634.031752:0:14371:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789776634.031760:0:14371:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789776634.035160:0:14365:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789776634.035178:0:14365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789776634.035251:0:14365:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789776634.035274:0:14365:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x26940258de8f0152 00000100:00080000:2.0:1789776634.035284:0:14365:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789776634.035290:0:14365:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c86b39ca800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1789776634.035330:0:14365:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c86ba6e8700 x1876716471540480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789776634.035350:0:14365:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789776634.035476:0:14365:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789776634.035481:0:14365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776634.035483:0:14365:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789776634.035487:0:14365:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789776634.035491:0:14365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776634.035492:0:14365:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789776634.035495:0:14365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789776634.035497:0:14365:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789776634.035499:0:14365:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789776634.035502:0:14365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776634.035503:0:14365:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789776634.035505:0:14365:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789776634.035507:0:14365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776634.035508:0:14365:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789776634.035511:0:14365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789776634.035676:0:14365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6e9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14365:1876716471540608:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789776634.035767:0:14365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776634.035814:0:14365:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8682e95b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789776634.035862:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471540608 00000100:00100000:3.0:1789776634.035869:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471540608 00000100:00100000:0.0:1789776634.035888:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3272:1876716471540480:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1789776634.035917:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000400:00000100:0.0:1789776634.035917:0:3272:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876716471540480 offset 0 length 520: 4 00000100:00100000:3.0:1789776634.035925:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+9:14365:x1876716471540608:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789776634.036209:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+9:14365:x1876716471540608:12345-0@lo:502:llog_process_th.0 Request processed in 283us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776634.036248:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789776634.036889:0:14365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6e9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14365:1876716471540608:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789776634.036923:0:14365:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789776634.036939:0:14365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776634.036941:0:14365:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789776634.036946:0:14365:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1789776634.039894:0:14329:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1789776634.039927:0:14329:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789776634.039944:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8681678000/0x26940258de8f00db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f00e2 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776634.039956:0:14329:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c8681678000/0x26940258de8f00db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f00e2 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776634.039966:0:14329:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c8688152000 from 1 10000000:01000000:3.0:1789776634.039969:0:14329:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789776634.040013:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8681679c00/0x26940258de8f0159 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776634.040039:0:14329:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c8681679c00/0x26940258de8f0159 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776634.040051:0:14329:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c8681679c00/0x26940258de8f0159 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776634.040089:0:14329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14329:1876716471540736:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789776634.040158:0:14329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776634.040202:0:14329:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c869866b840 going to sleep for 11 seconds 00000100:00100000:0.0:1789776634.040283:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471540736 00000100:00100000:0.0:1789776634.040290:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471540736 00000100:00100000:0.0:1789776634.040337:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789776634.040347:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+9:14329:x1876716471540736:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789776634.040361:0:14339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776634.040504:0:14339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c86b9b08600/0x26940258de8f0160 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8f0159 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776634.040621:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c86b9b08600/0x26940258de8f0160 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8f0159 expref: 10 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776634.040632:0:14339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c86b9b08600/0x26940258de8f0160 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8f0159 expref: 10 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776634.040641:0:14339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86b9b08600, rc 0) 00000100:00100000:0.0:1789776634.040692:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+10:14329:x1876716471540736:12345-0@lo:101:mount.lustre.0 Request processed in 346us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776634.040699:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789776634.040763:0:14329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14329:1876716471540736:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789776634.040779:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c8681679c00/0x26940258de8f0159 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f0160 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776634.040788:0:14329:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c8681679c00/0x26940258de8f0159 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8f0160 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776634.041350:0:14329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14329:1876716471540864:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1789776634.041392:0:14329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776634.041872:0:14329:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c869866b840 going to sleep for 11 seconds 00000100:00100000:1.0:1789776634.042718:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471540864 00000100:00100000:1.0:1789776634.042729:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471540864 00000100:00100000:1.0:1789776634.042786:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789776634.042797:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+10:14329:x1876716471540864:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1789776634.042833:0:14342:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789776634.042840:0:14342:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789776634.042953:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+10:14329:x1876716471540864:12345-0@lo:256:mount.lustre.0 Request processed in 158us (1560us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776634.042961:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789776634.043294:0:14329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14329:1876716471540864:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1789776634.047396:0:14329:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789776634.047437:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8681679c00/0x26940258de8f0159 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f0160 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776634.047452:0:14329:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c8681679c00/0x26940258de8f0159 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f0160 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776634.047479:0:14329:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c8688152000 from 1 10000000:01000000:3.0:1789776634.047482:0:14329:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789776634.047525:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8681678a00/0x26940258de8f0167 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776634.047544:0:14329:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c8681678a00/0x26940258de8f0167 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776634.047556:0:14329:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c8681678a00/0x26940258de8f0167 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776634.047582:0:14329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14329:1876716471540992:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789776634.047652:0:14329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776634.048031:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471540992 00000100:00100000:2.0:1789776634.048041:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471540992 00000100:00100000:2.0:1789776634.048099:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789776634.048108:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+10:14329:x1876716471540992:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789776634.048122:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776634.048137:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c8686774000/0x26940258de8f016e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8f0167 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776634.048163:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c8686774000/0x26940258de8f016e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8f0167 expref: 11 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776634.048175:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c8686774000/0x26940258de8f016e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8f0167 expref: 11 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776634.048183:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8686774000, rc 0) 00000100:00100000:3.0:1789776634.048642:0:14329:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c869866b840 going to sleep for 11 seconds 00000100:00100000:2.0:1789776634.048646:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+11:14329:x1876716471540992:12345-0@lo:101:mount.lustre.0 Request processed in 539us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776634.048652:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789776634.048663:0:14329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14329:1876716471540992:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789776634.048693:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c8681678a00/0x26940258de8f0167 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f016e expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776634.048704:0:14329:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c8681678a00/0x26940258de8f0167 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8f016e expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776634.048775:0:14329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14329:1876716471541120:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789776634.048804:0:14329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776634.048825:0:14329:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c869866b840 going to sleep for 11 seconds 00000100:00100000:0.0:1789776634.049073:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471541120 00000100:00100000:0.0:1789776634.049078:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471541120 00000100:00100000:0.0:1789776634.049118:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789776634.049127:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+11:14329:x1876716471541120:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789776634.049733:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+11:14329:x1876716471541120:12345-0@lo:501:mount.lustre.0 Request processed in 606us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776634.049741:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789776634.049831:0:14329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14329:1876716471541120:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789776634.049867:0:14329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14329:1876716471541248:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789776634.049915:0:14329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776634.049949:0:14329:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c869866b840 going to sleep for 11 seconds 00000100:00100000:2.0:1789776634.050125:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471541248 00000100:00100000:2.0:1789776634.050131:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471541248 00000100:00100000:2.0:1789776634.050169:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789776634.050177:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+11:14329:x1876716471541248:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789776634.050356:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+11:14329:x1876716471541248:12345-0@lo:503:mount.lustre.0 Request processed in 180us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776634.050363:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789776634.050432:0:14329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14329:1876716471541248:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789776634.050799:0:14373:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14373:1876716471541376:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789776634.050837:0:14373:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776634.050866:0:14373:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c869866b540 going to sleep for 11 seconds 00000100:00100000:1.0:1789776634.050916:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471541376 00000100:00100000:1.0:1789776634.050921:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471541376 00000100:00100000:1.0:1789776634.050954:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789776634.050962:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+11:14373:x1876716471541376:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789776634.051168:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+11:14373:x1876716471541376:12345-0@lo:502:llog_process_th.0 Request processed in 206us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776634.051175:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789776634.051339:0:14373:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14373:1876716471541376:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789776634.051362:0:14373:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789776634.051381:0:14373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776634.051383:0:14373:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789776634.051392:0:14373:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c8688152000 00000020:00000080:3.0:1789776634.051394:0:14373:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789776634.051401:0:14373:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789776634.051404:0:14373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776634.051405:0:14373:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789776634.051407:0:14373:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789776634.051409:0:14373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776634.051419:0:14373:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789776634.051424:0:14373:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c8688152000 00000020:00000080:3.0:1789776634.051425:0:14373:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789776634.051483:0:14373:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789776634.051487:0:14373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776634.051489:0:14373:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789776634.051491:0:14373:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789776634.051493:0:14373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776634.051494:0:14373:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789776634.051497:0:14373:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c8688152000 00000020:00000080:3.0:1789776634.051499:0:14373:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789776634.051530:0:14373:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14373:1876716471541504:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789776634.051580:0:14373:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776634.051599:0:14373:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c869866b540 going to sleep for 11 seconds 00000100:00100000:2.0:1789776634.053382:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471541504 00000100:00100000:2.0:1789776634.053400:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471541504 00000100:00100000:2.0:1789776634.053457:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789776634.053466:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+11:14373:x1876716471541504:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789776634.053727:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+11:14373:x1876716471541504:12345-0@lo:502:llog_process_th.0 Request processed in 261us (2145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776634.053735:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789776634.053973:0:14373:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14373:1876716471541504:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789776634.054019:0:14373:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789776634.054026:0:14373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776634.054028:0:14373:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789776634.054034:0:14373:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789776634.056028:0:14329:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1789776634.056070:0:14329:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789776634.056095:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8681678a00/0x26940258de8f0167 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f016e expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776634.056109:0:14329:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c8681678a00/0x26940258de8f0167 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f016e expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776634.056175:0:14329:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789776634.056179:0:14329:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c8688152000 10000000:01000000:2.0:1789776634.056181:0:14329:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c8688152000 10000000:01000000:2.0:1789776634.056186:0:14329:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789776634.056193:0:14329:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c8688152000 from 1 10000000:01000000:2.0:1789776634.056196:0:14329:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789776634.056255:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8686774e00/0x26940258de8f0175 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776634.056264:0:14329:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c8686774e00/0x26940258de8f0175 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776634.056276:0:14329:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c8686774e00/0x26940258de8f0175 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776634.056302:0:14329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6e9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14329:1876716471541632:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789776634.056621:0:14329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776634.056661:0:14329:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86a00da6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776634.057583:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471541632 00000100:00100000:3.0:1789776634.057594:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471541632 00000100:00100000:3.0:1789776634.057654:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789776634.057665:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af75cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+11:14329:x1876716471541632:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789776634.057680:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776634.057697:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c8681679400/0x26940258de8f017c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8f0175 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776634.057723:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c8681679400/0x26940258de8f017c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8f0175 expref: 12 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776634.057735:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c8681679400/0x26940258de8f017c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8f0175 expref: 12 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776634.057743:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8681679400, rc 0) 00000100:00100000:3.0:1789776634.057800:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af75cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+12:14329:x1876716471541632:12345-0@lo:101:mount.lustre.0 Request processed in 137us (1180us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776634.057806:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789776634.058154:0:14329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6e9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14329:1876716471541632:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789776634.058173:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c8686774e00/0x26940258de8f0175 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f017c expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776634.058182:0:14329:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c8686774e00/0x26940258de8f0175 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8f017c expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776634.058280:0:14329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6e9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14329:1876716471541760:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789776634.058313:0:14329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776634.058342:0:14329:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86a00da6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776634.058408:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471541760 00000100:00100000:0.0:1789776634.058423:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471541760 00000100:00100000:0.0:1789776634.058455:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789776634.058463:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af75c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+12:14329:x1876716471541760:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789776634.058739:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af75c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+12:14329:x1876716471541760:12345-0@lo:501:mount.lustre.0 Request processed in 276us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776634.058746:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789776634.059101:0:14329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6e9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14329:1876716471541760:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789776634.059138:0:14329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6e9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14329:1876716471541888:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789776634.059181:0:14329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776634.059209:0:14329:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86a00da6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776634.059715:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471541888 00000100:00100000:3.0:1789776634.059721:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471541888 00000100:00100000:3.0:1789776634.059768:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789776634.059776:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af75d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+12:14329:x1876716471541888:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789776634.059967:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af75d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+12:14329:x1876716471541888:12345-0@lo:503:mount.lustre.0 Request processed in 190us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776634.059974:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789776634.060190:0:14329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6e9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14329:1876716471541888:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789776634.067190:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6e9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14375:1876716471542016:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789776634.067329:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776634.067371:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471542016 00000100:00100000:3.0:1789776634.067378:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471542016 00000100:00100000:3.0:1789776634.067443:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789776634.067453:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af75dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+12:14375:x1876716471542016:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789776634.068502:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af75dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+12:14375:x1876716471542016:12345-0@lo:502:llog_process_th.0 Request processed in 1045us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776634.068513:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789776634.068595:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86a00dad80 going to sleep for 11 seconds 00000100:00100000:3.0:1789776634.068622:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6e9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14375:1876716471542016:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1789776634.068715:0:14375:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789776634.068805:0:14375:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9c86af8d8000) 00000020:00000080:3.0:1789776634.068826:0:14375:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1789776634.068915:0:14375:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c8688152000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789776634.068920:0:14375:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c8688152000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789776634.068922:0:14375:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c8688152000 4 00010000:00080000:3.0:1789776634.068952:0:14375:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c86af2e6800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.106@tcp at head 00010000:00010000:3.0:1789776634.075706:0:14375:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1789776634.075906:0:14375:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789776634.075944:0:14375:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789776634.075963:0:14375:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x26940258de8f018a 00000100:00080000:3.0:1789776634.075974:0:14375:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789776634.075980:0:14375:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c86af2e6800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1789776634.076016:0:14375:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c86b9e7e680 x1876716471542144/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789776634.091634:0:14375:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789776634.092174:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3272:1876716471542144:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789776634.092290:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776634.092357:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471542144 00000100:00100000:0.0:1789776634.092365:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471542144 00000100:00100000:3.0:1789776634.092384:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14375:1876716471542272:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789776634.092402:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789776634.092419:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3272:x1876716471542144:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789776634.092474:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3272:x1876716471542144:12345-0@lo:38:llog_process_th.0 Request processed in 64us (183us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789776634.092482:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789776634.092490:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776634.092511:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471542272 00000100:00100000:0.0:1789776634.092513:0:3272:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:3.0:1789776634.092514:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471542272 00000100:00080000:0.0:1789776634.092521:0:3272:0:(import.c:65:import_set_state_nolock()) ffff9c86af2e6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789776634.092525:0:3272:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789776634.092529:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3272:1876716471542144:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789776634.092545:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789776634.092551:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af75c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+12:14375:x1876716471542272:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789776634.093316:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af75c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+12:14375:x1876716471542272:12345-0@lo:502:llog_process_th.0 Request processed in 761us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776634.093324:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789776634.095509:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8687d1fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776634.095547:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14375:1876716471542272:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789776634.095590:0:14375:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1789776634.097515:0:14329:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1789776634.097550:0:14329:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789776634.097578:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8686774e00/0x26940258de8f0175 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f017c expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776634.097592:0:14329:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c8686774e00/0x26940258de8f0175 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f017c expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789776634.097645:0:14329:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789776634.097647:0:14329:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789776634.097648:0:14329:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789776634.097650:0:14329:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789776634.097651:0:14329:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789776634.097652:0:14329:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789776634.097658:0:14329:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789776634.097659:0:14329:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789776634.097661:0:14329:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789776634.097662:0:14329:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789776634.097665:0:14329:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1789776634.097668:0:14329:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789776634.097669:0:14329:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789776634.097670:0:14329:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789776634.097671:0:14329:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789776634.097672:0:14329:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789776634.097673:0:14329:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789776634.097674:0:14329:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789776634.097675:0:14329:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789776634.097676:0:14329:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789776634.097677:0:14329:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789776634.097701:0:14329:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789776634.097721:0:14329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14329:1876716471542400:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789776634.097787:0:14329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776634.097824:0:14329:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8698858b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789776634.097852:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471542400 00000100:00100000:3.0:1789776634.097857:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471542400 00000100:00100000:3.0:1789776634.097906:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789776634.097915:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af75d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+12:14329:x1876716471542400:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789776634.097942:0:14339:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789776634.097956:0:14339:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789776634.226960:0:14339:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789776634.226977:0:14339:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1789776634.227041:0:14363:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789776634.227046:0:14363:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789776634.227076:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c86b9b08c00/0x26940258de8f0191 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776634.227111:0:14363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c86b9b08600/0x26940258de8f0160 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8f0159 expref: 12 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776634.227121:0:14363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c86b9b08c00/0x26940258de8f0191 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776634.227161:0:14363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c86b9b08600/0x26940258de8f0160 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26940258de8f0159 expref: 12 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776634.227177:0:14363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c86b9b08600/0x26940258de8f0160 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26940258de8f0159 expref: 12 pid: 14339 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776634.227190:0:14363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14363:1876716471542528:0@lo:104: 00000100:00100000:0.0:1789776634.227298:0:14363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776634.227342:0:14363:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86af77d840 going to sleep for 11 seconds 00000100:00100000:1.0:1789776634.230552:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471542528 00000100:00100000:1.0:1789776634.230569:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471542528 00000100:00100000:1.0:1789776634.230639:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789776634.230651:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+3:14363:x1876716471542528:12345-0@lo:104: 00010000:00010000:1.0:1789776634.230668:0:14330:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c8681679c00/0x26940258de8f0159 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8f0160 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776634.230773:0:14330:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789776634.230779:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+3:14363:x1876716471542528:12345-0@lo:104: Request processed in 132us (3481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776634.230787:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1789776634.230812:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776634.230819:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c8681679c00/0x26940258de8f0159 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8f0160 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776634.230844:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681679c00 already unused, calling callback (ffffffffc1da0c20) 10000000:00010000:1.0:1789776634.230848:0:14336:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c8681679c00/0x26940258de8f0159 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26940258de8f0160 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776634.230856:0:14336:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c8681679c00/0x26940258de8f0159 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26940258de8f0160 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789776634.230863:0:14336:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c8681679c00/0x26940258de8f0159 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26940258de8f0160 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776634.230870:0:14336:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789776634.230906:0:14336:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c8681679c00/0x26940258de8f0159 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8f0160 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776634.230912:0:14336:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789776634.230931:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c8681679c00/0x26940258de8f0159 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8f0160 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776634.230937:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c8681679c00/0x26940258de8f0159 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8f0160 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776634.230957:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776634.230959:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776634.230961:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776634.230987:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789776634.230998:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:3273:1876716471542656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789776634.231037:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776634.231093:0:14363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14363:1876716471542528:0@lo:104: 00010000:00010000:1.0:1789776634.231114:0:14363:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c86b9b08c00/0x26940258de8f0191 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776634.231613:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471542656 00000100:00100000:3.0:1789776634.231620:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471542656 00010000:00010000:3.0:1789776634.231641:0:14332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c86b9b08600/0x26940258de8f0160 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8f0159 expref: 13 pid: 14339 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776634.231674:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789776634.231682:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+13:3273:x1876716471542656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789776634.231694:0:14332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776634.231705:0:14332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c86b9b08600/0x26940258de8f0160 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8f0159 expref: 13 pid: 14339 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776634.231715:0:14332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c86b9b08600/0x26940258de8f0160 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26940258de8f0159 expref: 13 pid: 14339 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776634.231730:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c86b9b08600/0x26940258de8f0160 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26940258de8f0159 expref: 13 pid: 14339 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776634.231745:0:14332:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c86b9b08c00/0x26940258de8f0191 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776634.231754:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c86b9b08c00/0x26940258de8f0191 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789776634.231768:0:14332:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004722700s 00010000:00010000:3.0:1789776634.231773:0:14332:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c86b9b08c00/0x26940258de8f0191 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776634.231779:0:14332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c86b9b08c00/0x26940258de8f0191 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776634.231786:0:14332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c86b9b08c00/0x26940258de8f0191 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776634.231792:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c86b9b08c00/0x26940258de8f0191 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776634.231797:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b08c00 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:3.0:1789776634.231802:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c86b9b08c00/0x26940258de8f0191 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776634.231824:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c86b9b08c00/0x26940258de8f0191 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776634.231838:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c86b9b08c00/0x26940258de8f0191 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776634.231848:0:14332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776634.231887:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+12:3273:x1876716471542656:12345-0@lo:103:ldlm_bl.0 Request processed in 205us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776634.231893:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789776634.231925:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:3273:1876716471542656:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789776634.231942:0:14363:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c86b9b08c00/0x26940258de8f0191 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776634.231949:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c86b9b08c00/0x26940258de8f0191 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776634.231955:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c86b9b08c00/0x26940258de8f0191 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776634.251175:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af75d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+11:14329:x1876716471542400:12345-0@lo:253:mount.lustre.0 Request processed in 153249us (153375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776634.251194:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789776634.251387:0:14329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14329:1876716471542400:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789776634.251402:0:14329:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789776634.251405:0:14329:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789776634.251406:0:14329:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789776634.251419:0:14329:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789776634.251420:0:14329:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789776634.251422:0:14329:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789776634.251423:0:14329:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789776634.251424:0:14329:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789776634.251425:0:14329:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789776634.251440:0:14329:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789776634.251442:0:14329:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789776634.251461:0:14329:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789776634.260560:0:14329:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1789776634.260759:0:14329:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789776634.261305:0:14329:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1789776634.261705:0:14329:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789776634.261987:0:14329:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1789776634.262639:0:14329:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1789776634.263718:0:14329:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1789776634.263900:0:14329:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1789776634.264504:0:14329:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1789776634.264740:0:14329:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1789776634.266982:0:14329:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1789776634.267339:0:14329:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1789776634.302955:0:14329:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1789776634.303798:0:14329:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1789776634.305395:0:14329:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789776634.305967:0:14329:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1789776634.311586:0:14386:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1789776634.311727:0:14386:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789776634.313707:0:14386:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789776634.313793:0:14386:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789776634.313798:0:14386:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00000080:3.0:1789776634.314334:0:14329:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789776634.314351:0:14329:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789776634.314652:0:14329:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789776634.315588:0:14329:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789776634.316103:0:14329:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789776634.316134:0:14329:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000020:00080000:1.0:1789776634.316543:0:14385:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1789776634.316547:0:14385:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00080000:10000000:3.0:1789776634.321877:0:14329:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1789776634.341634:0:14329:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1789776634.383277:0:14329:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789776634.383311:0:14329:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb98c41c47988 00100000:10000000:2.0:1789776634.383319:0:14329:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789776634.384169:0:14329:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789776634.384187:0:14329:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.106@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789776634.384201:0:14329:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1789776634.384244:0:14329:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1789776634.580833:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789776635.093944:0:14344:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789776635.093952:0:14344:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c8688152000 from 6 10000000:01000000:1.0:1789776635.093957:0:14344:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789776635.094038:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c86bf5cbc00/0x26940258de8f0198 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776635.094051:0:14344:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c86bf5cbc00/0x26940258de8f0198 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776635.094062:0:14344:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c86bf5cbc00/0x26940258de8f0198 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776635.094088:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14344:1876716471542784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789776635.094158:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776635.095026:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf1286c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776635.110812:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471542784 00000100:00100000:1.0:1789776635.110829:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471542784 00000100:00100000:1.0:1789776635.110901:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789776635.110911:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af75e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+11:14344:x1876716471542784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789776635.110929:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776635.110951:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c86bf5cbe00/0x26940258de8f019f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8f0198 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776635.110999:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c86bf5cbe00/0x26940258de8f019f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8f0198 expref: 12 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776635.111010:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c86bf5cbe00/0x26940258de8f019f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8f0198 expref: 12 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776635.111019:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86bf5cbe00, rc 0) 00000100:00100000:1.0:1789776635.111101:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af75e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+12:14344:x1876716471542784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 191us (16942us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776635.111108:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789776635.111157:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14344:1876716471542784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789776635.111174:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c86bf5cbc00/0x26940258de8f0198 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f019f expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776635.111184:0:14344:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c86bf5cbc00/0x26940258de8f0198 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8f019f expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776635.111282:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14344:1876716471542912:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789776635.111324:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776635.111352:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf1286c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776635.111366:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471542912 00000100:00100000:1.0:1789776635.111370:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471542912 00000100:00100000:1.0:1789776635.111387:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789776635.111393:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af75c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+12:14344:x1876716471542912:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789776635.111418:0:14339:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789776635.111434:0:14339:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789776635.111441:0:14339:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1789776635.111520:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af75c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+12:14344:x1876716471542912:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 126us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776635.111527:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789776635.111557:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14344:1876716471542912:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789776635.111798:0:14344:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789776635.111806:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c86bf5cbc00/0x26940258de8f0198 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f019f expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776635.111815:0:14344:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c86bf5cbc00/0x26940258de8f0198 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f019f expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789776635.157392:0:14381:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789776635.612611:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789776636.186040:0:14381:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789776636.633980:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776637.660868:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776638.676337:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776639.390541:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:3275:1876716471543040:0@lo:400:kworker.0 00000100:00100000:1.0:1789776639.390613:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789776639.390688:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789776639.390693:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789776639.390695:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789776639.390698:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789776639.390700:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789776639.390703:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789776639.390707:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c86af2e6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789776639.390716:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c86af2e6800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1789776639.390760:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c86ba6e8000 x1876716471543168/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789776639.390789:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3272:1876716471543168:0@lo:38:kworker.0 00000100:00100000:2.0:1789776639.390826:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776639.390874:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471543168 00000100:00100000:2.0:1789776639.390881:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471543168 00000100:00100000:2.0:1789776639.390926:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789776639.390932:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3272:x1876716471543168:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1789776639.390956:0:14349:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 392 last 0 00000020:00000080:2.0:1789776639.390990:0:14349:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x26940258de8f01a6 00000004:00100000:2.0:1789776639.391005:0:14349:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789776639.391396:0:14349:0:(import.c:65:import_set_state_nolock()) ffff9c8691e3a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789776639.391450:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3272:x1876716471543168:12345-0@lo:38:kworker.0 Request processed in 516us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776639.391458:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789776639.391501:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c86ba6e8000 x1876716471543168/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789776649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789776639.391516:0:3272:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789776639.391523:0:3272:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789776639.391528:0:3272:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789776639.391530:0:3272:0:(import.c:65:import_set_state_nolock()) ffff9c86af2e6800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789776639.391535:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3272:1876716471543168:0@lo:38:kworker.0 00000100:00100000:1.0:1789776639.399277:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471543040 00000100:00100000:1.0:1789776639.399300:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471543040 00000100:00100000:2.0:1789776639.402849:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789776639.402874:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af75f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+12:3275:x1876716471543040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776639.403007:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af75f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+12:3275:x1876716471543040:12345-0@lo:400:kworker.0 Request processed in 143us (12393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776639.403015:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789776639.405779:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:3275:1876716471543040:0@lo:400:kworker.0 00000001:02000400:0.0:1789776639.458641:0:14629:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789776639.700483:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776640.725885:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776641.750558:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789776642.487240:0:14779:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe502b8250 20000000:00000080:3.0:1789776642.487259:0:14779:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c86bb831c00 uarg=0000000000000000 20000000:01000000:3.0:1789776642.487292:0:14779:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789776642.487299:0:14779:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789776642.487304:0:14779:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789776642.488785:0:14780:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1789776642.488948:0:14779:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789776642.495419:0:14779:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789776642.495453:0:14779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c8686774c00/0x26940258de8f01ad lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776642.495489:0:14779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c8686774000/0x26940258de8f016e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8f0167 expref: 11 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776642.495498:0:14779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c8686774c00/0x26940258de8f01ad lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776642.495541:0:14779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c8686774000/0x26940258de8f016e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26940258de8f0167 expref: 11 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776642.495557:0:14779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c8686774000/0x26940258de8f016e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26940258de8f0167 expref: 11 pid: 14341 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776642.495571:0:14779:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6eb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14779:1876716471543296:0@lo:104: 00000100:00100000:2.0:1789776642.495638:0:14779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776642.495692:0:14779:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bc8f6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789776642.495769:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471543296 00000100:00100000:3.0:1789776642.495776:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471543296 00000100:00100000:3.0:1789776642.495830:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789776642.495840:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+3:14779:x1876716471543296:12345-0@lo:104: 00010000:00010000:3.0:1789776642.495852:0:14331:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c8681678a00/0x26940258de8f0167 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8f016e expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776642.496002:0:14331:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789776642.496016:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+3:14779:x1876716471543296:12345-0@lo:104: Request processed in 178us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776642.496023:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1789776642.496075:0:14335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776642.496082:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c8681678a00/0x26940258de8f0167 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8f016e expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776642.496089:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681678a00 already unused, calling callback (ffffffffc1da0c20) 10000000:00010000:2.0:1789776642.496093:0:14335:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c8681678a00/0x26940258de8f0167 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26940258de8f016e expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776642.496101:0:14335:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c8681678a00/0x26940258de8f0167 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26940258de8f016e expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776642.496107:0:14335:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c8681678a00/0x26940258de8f0167 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26940258de8f016e expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776642.496123:0:14335:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789776642.496161:0:14335:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c8681678a00/0x26940258de8f0167 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8f016e expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776642.496168:0:14335:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789776642.496188:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c8681678a00/0x26940258de8f0167 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8f016e expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776642.496195:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c8681678a00/0x26940258de8f0167 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8f016e expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776642.496211:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776642.496247:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776642.496250:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776642.496262:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:3276:1876716471543424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789776642.496301:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776642.499242:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471543424 00000100:00100000:3.0:1789776642.499260:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471543424 00010000:00010000:3.0:1789776642.499311:0:14332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c8686774000/0x26940258de8f016e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8f0167 expref: 12 pid: 14341 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776642.499368:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789776642.499379:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+12:3276:x1876716471543424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789776642.499394:0:14332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776642.499400:0:14332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c8686774000/0x26940258de8f016e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8f0167 expref: 12 pid: 14341 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776642.499413:0:14332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c8686774000/0x26940258de8f016e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26940258de8f0167 expref: 12 pid: 14341 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776642.499445:0:14332:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c8686774c00/0x26940258de8f01ad lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776642.499455:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c8686774c00/0x26940258de8f01ad lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776642.499473:0:14332:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c8686774c00/0x26940258de8f01ad lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776642.499480:0:14332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c8686774c00/0x26940258de8f01ad lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776642.499486:0:14332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c8686774c00/0x26940258de8f01ad lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776642.499510:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c8686774c00/0x26940258de8f01ad lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776642.499515:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8686774c00 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:3.0:1789776642.499519:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c8686774c00/0x26940258de8f01ad lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776642.499526:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c8686774c00/0x26940258de8f01ad lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776642.499536:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c8686774c00/0x26940258de8f01ad lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776642.499546:0:14332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776642.499618:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+12:3276:x1876716471543424:12345-0@lo:103:ldlm_bl.0 Request processed in 242us (3325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776642.499626:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789776642.499673:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:3276:1876716471543424:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789776642.502707:0:14779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c8686774000/0x26940258de8f016e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26940258de8f0167 expref: 11 pid: 14341 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776642.502726:0:14779:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6eb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14779:1876716471543296:0@lo:104: 00010000:00010000:1.0:1789776642.502753:0:14779:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c8686774c00/0x26940258de8f01ad lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776642.502762:0:14779:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c8686774c00/0x26940258de8f01ad lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776642.502786:0:14779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c8686774c00/0x26940258de8f01ad lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776642.502792:0:14779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c8686774c00/0x26940258de8f01ad lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776642.772966:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776643.805735:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789776644.180360:0:14344:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789776644.180370:0:14344:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c8688152000 from 10 10000000:01000000:3.0:1789776644.180377:0:14344:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789776644.180433:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8681678800/0x26940258de8f01b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776644.180444:0:14344:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c8681678800/0x26940258de8f01b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776644.180454:0:14344:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c8681678800/0x26940258de8f01b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776644.180493:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14344:1876716471543552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789776644.180582:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776644.180643:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf128780 going to sleep for 11 seconds 00000100:00100000:1.0:1789776644.180791:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471543552 00000100:00100000:1.0:1789776644.180799:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471543552 00000100:00100000:1.0:1789776644.180869:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789776644.180879:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af75e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+11:14344:x1876716471543552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789776644.180891:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776644.180904:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c86bf5ca600/0x26940258de8f01bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8f01b4 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776644.180927:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c86bf5ca600/0x26940258de8f01bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8f01b4 expref: 12 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776644.180936:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c86bf5ca600/0x26940258de8f01bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8f01b4 expref: 12 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776644.180945:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86bf5ca600, rc 0) 00000100:00100000:1.0:1789776644.180996:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af75e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+12:14344:x1876716471543552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776644.181003:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789776644.181241:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14344:1876716471543552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789776644.181258:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c8681678800/0x26940258de8f01b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f01bb expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776644.181266:0:14344:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c8681678800/0x26940258de8f01b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8f01bb expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776644.181321:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14344:1876716471543680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789776644.181360:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776644.181387:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf128780 going to sleep for 11 seconds 00000100:00100000:1.0:1789776644.181556:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471543680 00000100:00100000:1.0:1789776644.181560:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471543680 00000100:00100000:1.0:1789776644.181593:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789776644.181609:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af75fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+12:14344:x1876716471543680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789776644.182349:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af75fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+12:14344:x1876716471543680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 739us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776644.182357:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789776644.182506:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14344:1876716471543680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776644.182546:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14344:1876716471543808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789776644.182589:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776644.182620:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86af571cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776644.182790:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471543808 00000100:00100000:3.0:1789776644.182796:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471543808 00000100:00100000:3.0:1789776644.182852:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789776644.182860:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af75ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+12:14344:x1876716471543808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789776644.183027:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af75ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+12:14344:x1876716471543808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 168us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776644.183035:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789776644.183203:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14344:1876716471543808:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789776644.185004:0:14840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1789776644.186937:0:14344:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1789776644.186977:0:14344:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789776644.186989:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8681678800/0x26940258de8f01b4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f01bb expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776644.187037:0:14344:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c8681678800/0x26940258de8f01b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f01bb expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789776644.502144:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789776644.502151:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789776644.502154:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789776644.502157:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789776644.502172:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:3273:1876716471543936:0@lo:400:kworker.0 00000100:00100000:1.0:1789776644.502267:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776644.502293:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3274:1876716471544064:0@lo:400:kworker.0 00000100:00100000:2.0:1789776644.502334:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776644.502370:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471544064 00000100:00100000:1.0:1789776644.502378:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471544064 00000100:00100000:1.0:1789776644.502420:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789776644.502429:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1876716471544064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776644.502482:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1876716471544064:12345-0@lo:400:kworker.0 Request processed in 53us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776644.502489:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789776644.502552:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c86b9e7c700 x1876716471544064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776660 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776644.502567:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3274:1876716471544064:0@lo:400:kworker.0 00000100:00100000:3.0:1789776644.502862:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471543936 00000100:00100000:3.0:1789776644.502867:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471543936 00000100:00100000:3.0:1789776644.502901:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789776644.502909:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af75f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+12:3273:x1876716471543936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776644.502947:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af75f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+12:3273:x1876716471543936:12345-0@lo:400:kworker.0 Request processed in 40us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776644.502953:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789776644.503031:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:3273:1876716471543936:0@lo:400:kworker.0 00000100:00100000:2.0:1789776644.504118:0:3272:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789776634/real 1789776634] req@ffff9c86ba6e8700 x1876716471540480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789776644 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776644.504142:0:3272:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c86ba6e8700 x1876716471540480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789776644 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776644.504151:0:3272:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789776634/real 1789776634] req@ffff9c86ba6e8380 x1876716471540352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789776644 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776644.504163:0:3272:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c86ba6e8380 x1876716471540352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789776644 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789776644.504178:0:3272:0:(import.c:65:import_set_state_nolock()) ffff9c86b39ca800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789776644.504200:0:3272:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789776644.504204:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3272:1876716471540480:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789776644.504210:0:3272:0:(import.c:65:import_set_state_nolock()) ffff9c86af405800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789776644.504230:0:3272:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789776644.504233:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3272:1876716471540352:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789776644.504598:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789776644.504603:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789776644.504607:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c86af405800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789776644.504612:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 386 00000100:00080000:3.0:1789776644.504617:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789776644.504624:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c86af405800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1789776644.504656:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c86b9e7ce00 x1876716471544192/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789776644.504686:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789776644.504689:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789776644.504691:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c86b39ca800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789776644.504694:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 386 00000100:00080000:3.0:1789776644.504697:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789776644.504700:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c86b39ca800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1789776644.504712:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c86b9e7d180 x1876716471544320/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789776644.505296:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3272:1876716471544192:0@lo:8:kworker.0 00000400:00000100:2.0:1789776644.505371:0:3272:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876716471544192 offset 0 length 520: 4 00000100:00100000:2.0:1789776644.505411:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3272:1876716471544320:0@lo:8:kworker.0 00000400:00000100:2.0:1789776644.505444:0:3272:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876716471544320 offset 0 length 520: 4 00010000:00010000:2.0:1789776644.821388:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776645.851713:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789776646.426812:0:14381:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789776646.869530:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789776647.635283:0:15028:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789776647.635287:0:15028:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1789776647.635424:0:15028:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c86bc8e4800 00000020:01000004:0.0:1789776647.635457:0:15028:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789776647.635477:0:15028:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1789776647.635492:0:15028:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9c86920619b8) 00000020:00000080:0.0:1789776647.635510:0:15028:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789776647.667023:0:15028:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789776647.669019:0:15028:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789776647.669758:0:15028:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789776647.669930:0:15028:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1789776647.670088:0:15028:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1789776647.673005:0:15028:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 81: rc = 0 00100000:10000000:3.0:1789776647.673101:0:15028:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 81: rc = 0 00100000:10000000:3.0:1789776647.674019:0:15028:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 81: rc = 0 00100000:10000000:3.0:1789776647.676857:0:15028:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 452: rc = 0 00100000:10000000:3.0:1789776647.678802:0:15028:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 452: rc = 0 00100000:10000000:3.0:1789776647.679108:0:15028:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 452: rc = 0 00100000:10000000:3.0:1789776647.679535:0:15028:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 452: rc = 0 00100000:10000000:3.0:1789776647.680597:0:15028:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 452: rc = 0 00100000:10000000:3.0:1789776647.680876:0:15028:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 452: rc = 0 00000020:00000080:3.0:1789776647.681560:0:15028:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789776647.681572:0:15028:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789776647.681584:0:15028:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x26940258de8f01c9 00000020:01000004:3.0:1789776647.681592:0:15028:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1789776647.681615:0:15028:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.106@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789776647.681618:0:15028:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789776647.681624:0:15028:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789776647.681628:0:15028:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789776647.681650:0:15028:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9c86bb963370) 00000020:00000080:3.0:1789776647.681664:0:15028:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1789776647.685809:0:15028:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789776647.686054:0:15028:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789776647.686061:0:15028:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789776647.688114:0:15028:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789776647.688136:0:15028:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789776647.688828:0:15028:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789776647.688835:0:15028:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1789776647.702148:0:15028:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789776647.702428:0:15028:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1789776647.702434:0:15028:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1789776647.703776:0:15028:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1789776647.703784:0:15028:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789776647.738685:0:15028:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789776647.738982:0:15028:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789776647.738996:0:15028:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789776647.742193:0:15028:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789776647.742450:0:15028:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789776647.744333:0:15028:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789776647.744346:0:15028:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1789776647.746161:0:15028:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789776647.746448:0:15028:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789776647.746454:0:15028:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789776647.747374:0:15028:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789776647.747382:0:15028:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1789776647.804160:0:15028:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789776647.804431:0:15028:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1789776647.804439:0:15028:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1789776647.805735:0:15028:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1789776647.805746:0:15028:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789776647.808084:0:15028:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789776647.808112:0:15028:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1789776647.808184:0:15028:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.106@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1789776647.839785:0:15028:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.106@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789776647.839831:0:15028:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.106@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1789776647.839836:0:15028:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789776647.839838:0:15028:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789776647.839839:0:15028:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789776647.839841:0:15028:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789776647.839842:0:15028:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789776647.839843:0:15028:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789776647.839844:0:15028:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789776647.839846:0:15028:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789776647.839847:0:15028:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789776647.839852:0:15028:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1789776647.839854:0:15028:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789776647.839855:0:15028:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789776647.839857:0:15028:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789776647.839858:0:15028:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789776647.839859:0:15028:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789776647.839860:0:15028:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789776647.839861:0:15028:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789776647.839862:0:15028:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789776647.839862:0:15028:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789776647.839892:0:15028:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789776647.839920:0:15028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15028:1876716471544448:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789776647.840016:0:15028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776647.840153:0:15028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8691030a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789776647.843402:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471544448 00000100:00100000:1.0:1789776647.843417:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471544448 00000100:00100000:1.0:1789776647.843514:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789776647.843523:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af75e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+12:15028:x1876716471544448:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789776647.843570:0:14339:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789776647.843573:0:14339:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1789776647.843576:0:14339:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789776647.853857:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af75e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+12:15028:x1876716471544448:12345-0@lo:253:mount.lustre.0 Request processed in 10325us (13832us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776647.853870:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789776647.853982:0:15028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15028:1876716471544448:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789776647.853997:0:15028:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789776647.854013:0:15028:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789776647.854015:0:15028:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789776647.854017:0:15028:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789776647.854018:0:15028:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789776647.854019:0:15028:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789776647.854020:0:15028:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789776647.854022:0:15028:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789776647.854024:0:15028:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789776647.854025:0:15028:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789776647.854046:0:15028:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c86bc8e4800 from lustre-OST0000 10000000:01000000:3.0:1789776647.854071:0:15028:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789776647.854074:0:15028:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789776647.854083:0:15028:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c86b9903370 local copy 00010000:00010000:3.0:1789776647.854093:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8686775a00/0x26940258de8f00bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f00c6 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776647.854361:0:15028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15028:1876716471544576:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789776647.854397:0:15028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776647.854423:0:15028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8691030600 going to sleep for 11 seconds 00000100:00100000:1.0:1789776647.854717:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471544576 00000100:00100000:1.0:1789776647.854723:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471544576 00000100:00100000:1.0:1789776647.854768:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789776647.854777:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+12:15028:x1876716471544576:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789776647.854937:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+12:15028:x1876716471544576:12345-0@lo:501:mount.lustre.0 Request processed in 161us (539us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789776647.854944:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789776647.855128:0:15028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15028:1876716471544576:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789776647.855142:0:15028:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789776647.859925:0:15028:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789776647.859941:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8686775a00/0x26940258de8f00bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f00c6 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776647.859966:0:15028:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c8686775a00/0x26940258de8f00bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f00c6 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776647.859997:0:15028:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c86bc8e4800 10000000:01000000:2.0:1789776647.860002:0:15028:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789776647.860008:0:15028:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9c86b9903370 10000000:01000000:2.0:1789776647.860010:0:15028:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789776647.860015:0:15028:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9c86b9903370 from 1 10000000:01000000:2.0:1789776647.860018:0:15028:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789776647.860057:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8686774c00/0x26940258de8f01d7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776647.860065:0:15028:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c8686774c00/0x26940258de8f01d7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776647.860075:0:15028:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c8686774c00/0x26940258de8f01d7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776647.860098:0:15028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15028:1876716471544704:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789776647.860167:0:15028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776647.860413:0:15028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86af571240 going to sleep for 11 seconds 00000100:00100000:1.0:1789776647.862433:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471544704 00000100:00100000:1.0:1789776647.862445:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471544704 00000100:00100000:1.0:1789776647.862518:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789776647.862527:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+12:15028:x1876716471544704:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789776647.862543:0:14339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776647.862563:0:14339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c86bf5ca000/0x26940258de8f01de lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8f01d7 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776647.862611:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c86bf5ca000/0x26940258de8f01de lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8f01d7 expref: 13 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776647.862621:0:14339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c86bf5ca000/0x26940258de8f01de lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8f01d7 expref: 13 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776647.862629:0:14339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86bf5ca000, rc 0) 00000100:00100000:1.0:1789776647.862711:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+13:15028:x1876716471544704:12345-0@lo:101:mount.lustre.0 Request processed in 185us (2545us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776647.862718:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789776647.862914:0:15028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15028:1876716471544704:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789776647.862931:0:15028:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c8686774c00/0x26940258de8f01d7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f01de expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776647.862941:0:15028:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c8686774c00/0x26940258de8f01d7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8f01de expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789776647.862978:0:15028:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789776647.862994:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8686774c00/0x26940258de8f01d7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f01de expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776647.863002:0:15028:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c8686774c00/0x26940258de8f01d7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f01de expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789776647.863010:0:15028:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789776647.863015:0:15028:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789776647.863021:0:15028:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789776647.863024:0:15028:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789776647.863050:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c86b9b09800/0x26940258de8f01e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776647.863058:0:15028:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c86b9b09800/0x26940258de8f01e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776647.863077:0:15028:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c86b9b09800/0x26940258de8f01e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776647.863097:0:15028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15028:1876716471544832:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789776647.863131:0:15028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776647.863165:0:15028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86aa786b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789776647.863386:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471544832 00000100:00100000:1.0:1789776647.863392:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471544832 00000100:00100000:1.0:1789776647.863429:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789776647.863436:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+13:15028:x1876716471544832:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789776647.863445:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776647.863456:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c86bf5cac00/0x26940258de8f01ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8f01e5 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776647.863470:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c86bf5cac00/0x26940258de8f01ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8f01e5 expref: 14 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776647.863644:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c86bf5cac00/0x26940258de8f01ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8f01e5 expref: 14 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776647.863653:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86bf5cac00, rc 0) 00000100:00100000:1.0:1789776647.863971:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+14:15028:x1876716471544832:12345-0@lo:101:mount.lustre.0 Request processed in 533us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776647.863987:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789776647.870976:0:15028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15028:1876716471544832:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789776647.871011:0:15028:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c86b9b09800/0x26940258de8f01e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f01ec expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776647.871024:0:15028:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c86b9b09800/0x26940258de8f01e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8f01ec expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789776647.872118:0:15028:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1789776647.876165:0:15028:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789776647.876740:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789776647.876788:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789776647.876826:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789776647.876875:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789776647.876912:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789776647.876962:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789776647.877029:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789776647.877037:0:15028:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789776647.877139:0:15028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6e8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15028:1876716471544960:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789776647.877251:0:15028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776647.877296:0:15028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8690681180 going to sleep for 11 seconds 00000100:00100000:3.0:1789776647.877441:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471544960 00000100:00100000:3.0:1789776647.877449:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471544960 00000100:00100000:3.0:1789776647.877507:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789776647.877517:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb574050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+14:15028:x1876716471544960:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789776647.877854:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb574050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+14:15028:x1876716471544960:12345-0@lo:501:mount.lustre.0 Request processed in 338us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776647.877862:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789776647.878000:0:15028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6e8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15028:1876716471544960:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789776647.878036:0:15028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6e8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15028:1876716471545088:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789776647.878074:0:15028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776647.878131:0:15028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8690681180 going to sleep for 11 seconds 00000100:00100000:1.0:1789776647.878444:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471545088 00000100:00100000:1.0:1789776647.878450:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471545088 00000100:00100000:1.0:1789776647.878526:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789776647.878534:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb577450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+14:15028:x1876716471545088:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789776647.878895:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb577450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+14:15028:x1876716471545088:12345-0@lo:503:mount.lustre.0 Request processed in 361us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776647.878902:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789776647.878978:0:15028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6e8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15028:1876716471545088:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789776647.879754:0:15028:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789776647.879832:0:15028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6e8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15028:1876716471545216:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789776647.879887:0:15028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776647.880365:0:15028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bc8f6180 going to sleep for 11 seconds 00000100:00100000:3.0:1789776647.880506:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471545216 00000100:00100000:3.0:1789776647.880513:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471545216 00000100:00100000:3.0:1789776647.880546:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789776647.880555:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+14:15028:x1876716471545216:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789776647.880783:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+14:15028:x1876716471545216:12345-0@lo:502:mount.lustre.0 Request processed in 229us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776647.880790:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789776647.880888:0:15028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6e8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15028:1876716471545216:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789776647.881149:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1789776647.881372:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1789776647.881415:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1789776647.881463:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1789776647.881497:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1789776647.881529:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1789776647.881591:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1789776647.881626:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1789776647.881657:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1789776647.881701:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1789776647.881736:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1789776647.881798:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1789776647.881835:0:15028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6e8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15028:1876716471545344:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789776647.881886:0:15028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776647.881913:0:15028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bc8f6180 going to sleep for 11 seconds 00000100:00100000:3.0:1789776647.881984:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471545344 00000100:00100000:3.0:1789776647.881989:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471545344 00000100:00100000:3.0:1789776647.882015:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789776647.882022:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb577c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+14:15028:x1876716471545344:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789776647.882179:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb577c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+14:15028:x1876716471545344:12345-0@lo:502:mount.lustre.0 Request processed in 156us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776647.882186:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789776647.882492:0:15028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6e8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15028:1876716471545344:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789776647.882560:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1789776647.882568:0:15028:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1789776647.883549:0:15042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789776647.883557:0:15042:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1789776647.883564:0:15042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789776647.883566:0:15042:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789776647.883572:0:15042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789776647.883587:0:15042:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9c86a01a99b8) 00000020:00000080:2.0:1789776647.883608:0:15042:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789776647.883613:0:15042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789776647.883671:0:15042:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c86bc8e4800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789776647.883678:0:15042:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789776647.883683:0:15042:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x26940258de8f01fa 00010000:00010000:0.0:1789776647.892592:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776647.893556:0:15042:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1789776647.893952:0:15042:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1789776647.896044:0:15042:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1789776647.902472:0:15042:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789776647.902487:0:15042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789776647.902504:0:15042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776647.902507:0:15042:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789776647.902511:0:15042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789776647.902514:0:15042:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1789776647.902516:0:15042:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789776647.902517:0:15042:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789776647.902519:0:15042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789776647.902521:0:15042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776647.902523:0:15042:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789776647.902525:0:15042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789776647.902528:0:15042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776647.902529:0:15042:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789776647.902532:0:15042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789776647.902534:0:15042:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789776647.902537:0:15042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789776647.902539:0:15042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776647.902540:0:15042:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789776647.902542:0:15042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789776647.902544:0:15042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776647.902546:0:15042:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789776647.902549:0:15042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789776647.902622:0:15042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789776647.902625:0:15042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776647.902627:0:15042:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789776647.902630:0:15042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1789776647.903974:0:15028:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1789776647.904010:0:15028:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789776647.904036:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c86b9b09800/0x26940258de8f01e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f01ec expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776647.904050:0:15028:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c86b9b09800/0x26940258de8f01e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f01ec expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776647.904070:0:15028:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c86bc8e4800 from 1 10000000:01000000:3.0:1789776647.904073:0:15028:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789776647.904110:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8681679a00/0x26940258de8f0201 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776647.904118:0:15028:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c8681679a00/0x26940258de8f0201 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776647.904128:0:15028:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c8681679a00/0x26940258de8f0201 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776647.904154:0:15028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15028:1876716471545472:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789776647.904250:0:15028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776647.904287:0:15028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8691030780 going to sleep for 11 seconds 00000100:00100000:3.0:1789776647.904322:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471545472 00000100:00100000:3.0:1789776647.904329:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471545472 00000100:00100000:3.0:1789776647.904370:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789776647.904380:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+14:15028:x1876716471545472:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789776647.904392:0:14342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776647.904404:0:14342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c8681678200/0x26940258de8f0208 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8f0201 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776647.904426:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c8681678200/0x26940258de8f0208 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8f0201 expref: 15 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776647.904436:0:14342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c8681678200/0x26940258de8f0208 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8f0201 expref: 15 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776647.904455:0:14342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8681678200, rc 0) 00000100:00100000:3.0:1789776647.904558:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+15:15028:x1876716471545472:12345-0@lo:101:mount.lustre.0 Request processed in 179us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776647.904565:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789776647.904610:0:15028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15028:1876716471545472:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789776647.904622:0:15028:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c8681679a00/0x26940258de8f0201 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f0208 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776647.904631:0:15028:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c8681679a00/0x26940258de8f0201 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8f0208 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789776647.905125:0:15028:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789776647.905904:0:15028:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789776647.906141:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789776647.906184:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789776647.906463:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789776647.906472:0:15028:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789776647.906645:0:15028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15028:1876716471545600:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789776647.906698:0:15028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776647.906776:0:15028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8691030780 going to sleep for 11 seconds 00000100:00100000:0.0:1789776647.906819:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471545600 00000100:00100000:0.0:1789776647.906825:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471545600 00000100:00100000:0.0:1789776647.906893:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789776647.906902:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+15:15028:x1876716471545600:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789776647.907135:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+15:15028:x1876716471545600:12345-0@lo:501:mount.lustre.0 Request processed in 233us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776647.907143:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789776647.907355:0:15028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15028:1876716471545600:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789776647.907391:0:15028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6e8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15028:1876716471545728:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789776647.907431:0:15028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776647.907568:0:15028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bc8f6900 going to sleep for 11 seconds 00000100:00100000:0.0:1789776647.907620:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471545728 00000100:00100000:0.0:1789776647.907624:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471545728 00000100:00100000:0.0:1789776647.907689:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789776647.907696:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+15:15028:x1876716471545728:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789776647.907838:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+15:15028:x1876716471545728:12345-0@lo:503:mount.lustre.0 Request processed in 142us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776647.907846:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789776647.907941:0:15028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6e8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15028:1876716471545728:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789776647.908739:0:15028:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789776647.908812:0:15028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15028:1876716471545856:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789776647.908853:0:15028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776647.908917:0:15028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bc8f6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789776647.908954:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471545856 00000100:00100000:3.0:1789776647.908959:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471545856 00000100:00100000:3.0:1789776647.909038:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789776647.909048:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+15:15028:x1876716471545856:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789776647.909263:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+15:15028:x1876716471545856:12345-0@lo:502:mount.lustre.0 Request processed in 217us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776647.909279:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789776647.909372:0:15028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15028:1876716471545856:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789776647.909607:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1789776647.909652:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1789776647.909693:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1789776647.909728:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1789776647.909758:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1789776647.909819:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1789776647.909855:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1789776647.909889:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1789776647.909919:0:15028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15028:1876716471545984:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789776647.909960:0:15028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776647.911570:0:15028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bc8f6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789776647.912147:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471545984 00000100:00100000:0.0:1789776647.912156:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471545984 00000100:00100000:0.0:1789776647.912240:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789776647.912251:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb576050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+15:15028:x1876716471545984:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789776647.913454:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb576050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+15:15028:x1876716471545984:12345-0@lo:502:mount.lustre.0 Request processed in 1199us (3487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776647.913466:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789776647.914865:0:15028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15028:1876716471545984:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789776647.915173:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1789776647.915190:0:15028:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1789776647.922319:0:15046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789776647.922335:0:15046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776647.922338:0:15046:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789776647.922345:0:15046:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c86bc8e4800 00000020:00000080:3.0:1789776647.922348:0:15046:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789776647.922355:0:15046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789776647.922358:0:15046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776647.922359:0:15046:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789776647.922362:0:15046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789776647.922364:0:15046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776647.922365:0:15046:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789776647.922368:0:15046:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c86bc8e4800 00000020:00000080:3.0:1789776647.922370:0:15046:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789776647.922434:0:15046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789776647.922438:0:15046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776647.922440:0:15046:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789776647.922443:0:15046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789776647.922445:0:15046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776647.922446:0:15046:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789776647.922449:0:15046:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c86bc8e4800 00000020:00000080:3.0:1789776647.922451:0:15046:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789776647.922487:0:15046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789776647.922490:0:15046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776647.922492:0:15046:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789776647.922505:0:15046:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1789776647.922906:0:15028:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1789776647.922931:0:15028:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789776647.922955:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8681679a00/0x26940258de8f0201 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f0208 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776647.922966:0:15028:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c8681679a00/0x26940258de8f0201 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f0208 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776647.923010:0:15028:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789776647.923017:0:15028:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c86bc8e4800 10000000:01000000:2.0:1789776647.923020:0:15028:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c86bc8e4800 10000000:01000000:2.0:1789776647.923024:0:15028:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789776647.923030:0:15028:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c86bc8e4800 from 1 10000000:01000000:2.0:1789776647.923033:0:15028:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789776647.923071:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8686774000/0x26940258de8f020f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776647.923079:0:15028:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c8686774000/0x26940258de8f020f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776647.923089:0:15028:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c8686774000/0x26940258de8f020f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776647.923386:0:15028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15028:1876716471546112:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789776647.923461:0:15028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776647.923540:0:15028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bc8f63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776647.923697:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471546112 00000100:00100000:3.0:1789776647.923705:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471546112 00000100:00100000:3.0:1789776647.923792:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789776647.923802:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb576450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+15:15028:x1876716471546112:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789776647.923816:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776647.923834:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c8681678e00/0x26940258de8f0216 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8f020f expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776647.923857:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c8681678e00/0x26940258de8f0216 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8f020f expref: 16 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776647.923867:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c8681678e00/0x26940258de8f0216 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8f020f expref: 16 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776647.923875:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8681678e00, rc 0) 00000100:00100000:3.0:1789776647.923955:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb576450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+16:15028:x1876716471546112:12345-0@lo:101:mount.lustre.0 Request processed in 153us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776647.923962:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789776647.924053:0:15028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15028:1876716471546112:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789776647.924068:0:15028:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c8686774000/0x26940258de8f020f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f0216 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776647.924078:0:15028:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c8686774000/0x26940258de8f020f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8f0216 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789776647.928852:0:15028:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1789776647.929528:0:15028:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789776647.929804:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1789776647.929846:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1789776647.929866:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1789776647.929892:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1789776647.929920:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1789776647.929946:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1789776647.929963:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1789776647.929979:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1789776647.930003:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1789776647.930033:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1789776647.930050:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1789776647.930074:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1789776647.930091:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1789776647.930106:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1789776647.930470:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1789776647.930511:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1789776647.930546:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1789776647.930591:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1789776647.930626:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1789776647.930657:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1789776647.930702:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1789776647.930734:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1789776647.930763:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1789776647.930806:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1789776647.930838:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1789776647.930886:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1789776647.930934:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1789776647.930969:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1789776647.931045:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1789776647.931054:0:15028:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1789776647.934497:0:15028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15028:1876716471546240:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789776647.934573:0:15028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776647.934626:0:15028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bc8f63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776647.934912:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471546240 00000100:00100000:1.0:1789776647.934920:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471546240 00000100:00100000:1.0:1789776647.934975:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789776647.934985:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+16:15028:x1876716471546240:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789776647.935295:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+16:15028:x1876716471546240:12345-0@lo:501:mount.lustre.0 Request processed in 311us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776647.935314:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789776647.936105:0:15028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15028:1876716471546240:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789776647.936166:0:15028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15028:1876716471546368:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789776647.936476:0:15028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776647.936503:0:15028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bc8f63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776647.938842:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471546368 00000100:00100000:1.0:1789776647.938856:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471546368 00000100:00100000:1.0:1789776647.938919:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789776647.938930:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb574450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+16:15028:x1876716471546368:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789776647.939194:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb574450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+16:15028:x1876716471546368:12345-0@lo:503:mount.lustre.0 Request processed in 265us (2717us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776647.939203:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789776647.939336:0:15028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15028:1876716471546368:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789776647.939894:0:15028:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789776647.939969:0:15028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15028:1876716471546496:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789776647.940019:0:15028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776647.940057:0:15028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bc8f63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776647.940149:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471546496 00000100:00100000:1.0:1789776647.940154:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471546496 00000100:00100000:1.0:1789776647.940184:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789776647.940191:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8691f52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+16:15028:x1876716471546496:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789776647.940416:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8691f52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+16:15028:x1876716471546496:12345-0@lo:502:mount.lustre.0 Request processed in 224us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776647.940423:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789776647.940468:0:15028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15028:1876716471546496:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789776647.940696:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789776647.940752:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1789776647.940787:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1789776647.940835:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1789776647.940872:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1789776647.940941:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1789776647.940993:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1789776647.941026:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1789776647.941077:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789776647.941114:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1789776647.941144:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1789776647.941198:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1789776647.941261:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1789776647.941293:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1789776647.941360:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1789776647.941395:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1789776647.941426:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1789776647.941467:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1789776647.941503:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1789776647.941533:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1789776647.941575:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1789776647.941610:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1789776647.941658:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1789776647.941706:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1789776647.941743:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1789776647.941776:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1789776647.941821:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1789776647.941855:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1789776647.941889:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1789776647.941932:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1789776647.941966:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1789776647.941999:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1789776647.942032:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1789776647.942080:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1789776647.942122:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1789776647.942166:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1789776647.942197:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1789776647.942258:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1789776647.942342:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1789776647.942378:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1789776647.942428:0:15028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7bd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15028:1876716471546624:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789776647.942507:0:15028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776647.942560:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471546624 00000100:00100000:1.0:1789776647.942566:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471546624 00000100:00100000:1.0:1789776647.942616:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789776647.942625:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8691f52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+16:15028:x1876716471546624:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789776647.942828:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8691f52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+16:15028:x1876716471546624:12345-0@lo:502:mount.lustre.0 Request processed in 203us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776647.942835:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789776647.942881:0:15028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8690489000 going to sleep for 11 seconds 00000100:00100000:1.0:1789776647.942902:0:15028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7bd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15028:1876716471546624:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789776647.942970:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1789776647.942981:0:15028:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1789776647.949841:0:15051:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789776647.949863:0:15051:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9c86bab619b8) 00000020:00000080:1.0:1789776647.949889:0:15051:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1789776647.949962:0:15051:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c86bc8e4800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789776647.949968:0:15051:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c86bc8e4800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789776647.949971:0:15051:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c86bc8e4800 3 00010000:00080000:1.0:1789776647.950005:0:15051:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c8698929000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.106@tcp at head 00010000:00010000:1.0:1789776647.952570:0:15051:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1789776647.952800:0:15051:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789776647.952852:0:15051:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789776647.952867:0:15051:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x26940258de8f0224 00000100:00080000:1.0:1789776647.952880:0:15051:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789776647.952887:0:15051:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c8698929000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1789776647.952927:0:15051:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c86bf7bd880 x1876716471546752/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789776647.952953:0:15051:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789776647.952985:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789776647.952990:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789776647.952993:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789776647.952996:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789776647.953142:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789776647.953159:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876716471546880:0@lo:400:kworker.0 00000100:00100000:2.0:1789776647.953173:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3272:1876716471546752:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789776647.955093:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776647.955189:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471546752 00000100:00100000:1.0:1789776647.955199:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471546752 00000100:00100000:2.0:1789776647.955234:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776647.955242:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471546880 00000100:00100000:1.0:1789776647.955245:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471546880 00000100:00100000:2.0:1789776647.955270:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789776647.955281:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876716471546880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776647.955346:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876716471546880:12345-0@lo:400:kworker.0 Request processed in 68us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776647.956574:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789776647.956584:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3272:x1876716471546752:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789776647.956613:0:14347:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 400 last 0 00000020:00000080:1.0:1789776647.956668:0:14347:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x26940258de8f022b 00000004:00100000:1.0:1789776647.956685:0:14347:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789776647.956724:0:14347:0:(import.c:65:import_set_state_nolock()) ffff9c86b641c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789776647.956843:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3272:x1876716471546752:12345-0@lo:38:llog_process_th.0 Request processed in 259us (1758us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776647.956851:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789776647.957046:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c86bf7bd880 x1876716471546752/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789776657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776647.957058:0:3272:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789776647.957067:0:3272:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1789776647.957077:0:3272:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789776647.957082:0:3272:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789776647.957084:0:3272:0:(import.c:65:import_set_state_nolock()) ffff9c8698929000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789776647.957091:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3272:1876716471546752:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789776647.957645:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789776647.957686:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c86bf7bd180 x1876716471546880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776647.957698:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876716471546880:0@lo:400:kworker.0 00000040:00080000:3.0:1789776647.957787:0:15051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1789776647.959799:0:15028:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1789776647.959838:0:15028:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789776647.959859:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8686774000/0x26940258de8f020f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f0216 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776647.959870:0:15028:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c8686774000/0x26940258de8f020f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f0216 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789776647.959912:0:15028:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789776647.959914:0:15028:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789776647.959915:0:15028:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789776647.959917:0:15028:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789776647.959917:0:15028:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789776647.959919:0:15028:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789776647.959920:0:15028:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789776647.959922:0:15028:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789776647.959923:0:15028:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789776647.959926:0:15028:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1789776647.959929:0:15028:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789776647.959930:0:15028:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789776647.959931:0:15028:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789776647.959932:0:15028:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789776647.959933:0:15028:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789776647.959935:0:15028:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789776647.959935:0:15028:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789776647.959936:0:15028:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789776647.959937:0:15028:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789776647.959962:0:15028:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789776647.959981:0:15028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e79c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15028:1876716471547008:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789776647.960049:0:15028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776647.960165:0:15028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8682ce0300 going to sleep for 11 seconds 00000100:00100000:1.0:1789776647.960387:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471547008 00000100:00100000:1.0:1789776647.960396:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471547008 00000100:00100000:1.0:1789776647.960449:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789776647.960457:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba880850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+16:15028:x1876716471547008:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789776647.960483:0:14341:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789776647.960568:0:14341:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789776647.991576:0:14341:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789776647.991601:0:14341:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1789776647.991708:0:14363:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789776647.991715:0:14363:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789776647.991738:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c86bf5ca800/0x26940258de8f0232 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776647.991757:0:14363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c86bf5cbe00/0x26940258de8f019f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8f0198 expref: 16 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776647.991766:0:14363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c86bf5ca800/0x26940258de8f0232 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776647.991808:0:14363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c86bf5cbe00/0x26940258de8f019f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26940258de8f0198 expref: 16 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776647.991824:0:14363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c86bf5cbe00/0x26940258de8f019f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26940258de8f0198 expref: 16 pid: 14341 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776647.991838:0:14363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7bc700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14363:1876716471547136:0@lo:104: 00000100:00100000:1.0:1789776647.991905:0:14363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776647.991958:0:14363:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8582d7cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789776647.992003:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471547136 00000100:00100000:3.0:1789776647.992011:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471547136 00000100:00100000:3.0:1789776647.992083:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789776647.992096:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+3:14363:x1876716471547136:12345-0@lo:104: 00010000:00010000:3.0:1789776647.992109:0:14330:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c86bf5cbc00/0x26940258de8f0198 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8f019f expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776647.992168:0:14330:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789776647.992174:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+3:14363:x1876716471547136:12345-0@lo:104: Request processed in 83us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776647.992183:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1789776647.992245:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789776647.992253:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c86bf5cbc00/0x26940258de8f0198 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8f019f expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776647.992261:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5cbc00 already unused, calling callback (ffffffffc1da0c20) 10000000:00010000:3.0:1789776647.992265:0:14336:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c86bf5cbc00/0x26940258de8f0198 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26940258de8f019f expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776647.992274:0:14336:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c86bf5cbc00/0x26940258de8f0198 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26940258de8f019f expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789776647.992282:0:14336:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c86bf5cbc00/0x26940258de8f0198 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26940258de8f019f expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776647.992289:0:14336:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789776647.992332:0:14336:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c86bf5cbc00/0x26940258de8f0198 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8f019f expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776647.992340:0:14336:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789776647.992377:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c86bf5cbc00/0x26940258de8f0198 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8f019f expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776647.992395:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c86bf5cbc00/0x26940258de8f0198 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8f019f expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776647.992416:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776647.992418:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776647.992420:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776647.992437:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789776647.992449:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:3275:1876716471547264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789776647.992492:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776647.992553:0:14363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7bc700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14363:1876716471547136:0@lo:104: 00010000:00010000:3.0:1789776647.992571:0:14363:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c86bf5ca800/0x26940258de8f0232 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776647.992611:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471547264 00000100:00100000:0.0:1789776647.992617:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471547264 00010000:00010000:0.0:1789776647.992637:0:14334:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c86bf5cbe00/0x26940258de8f019f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8f0198 expref: 17 pid: 14341 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776647.992667:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789776647.992674:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+17:3275:x1876716471547264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789776647.992684:0:14334:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776647.992688:0:14334:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c86bf5cbe00/0x26940258de8f019f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8f0198 expref: 17 pid: 14341 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776647.992698:0:14334:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c86bf5cbe00/0x26940258de8f019f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26940258de8f0198 expref: 17 pid: 14341 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776647.992747:0:14334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c86bf5cbe00/0x26940258de8f019f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26940258de8f0198 expref: 17 pid: 14341 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776647.992759:0:14334:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c86bf5ca800/0x26940258de8f0232 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776647.992766:0:14334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c86bf5ca800/0x26940258de8f0232 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789776647.992803:0:14334:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004722700s 00010000:00010000:0.0:1789776647.992808:0:14334:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c86bf5ca800/0x26940258de8f0232 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776647.992815:0:14334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c86bf5ca800/0x26940258de8f0232 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776647.992821:0:14334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c86bf5ca800/0x26940258de8f0232 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776647.992834:0:14334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c86bf5ca800/0x26940258de8f0232 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776647.992839:0:14334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5ca800 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:0.0:1789776647.992843:0:14334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c86bf5ca800/0x26940258de8f0232 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776647.992850:0:14334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c86bf5ca800/0x26940258de8f0232 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776647.992863:0:14334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c86bf5ca800/0x26940258de8f0232 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776647.992872:0:14334:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776647.992906:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+16:3275:x1876716471547264:12345-0@lo:103:ldlm_bl.0 Request processed in 232us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776647.992913:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789776647.993422:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:3275:1876716471547264:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789776647.993446:0:14363:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c86bf5ca800/0x26940258de8f0232 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776647.993453:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c86bf5ca800/0x26940258de8f0232 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776647.993460:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c86bf5ca800/0x26940258de8f0232 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776648.003278:0:15028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e79c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15028:1876716471547008:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789776648.003309:0:15028:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789776648.003313:0:15028:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789776648.003315:0:15028:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789776648.003316:0:15028:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789776648.003317:0:15028:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789776648.003318:0:15028:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789776648.003320:0:15028:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789776648.003321:0:15028:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789776648.003324:0:15028:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789776648.003325:0:15028:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789776648.003342:0:15028:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1789776648.004273:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba880850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+15:15028:x1876716471547008:12345-0@lo:253:mount.lustre.0 Request processed in 43811us (44218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776648.004287:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00080000:10000000:1.0:1789776648.009094:0:15028:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1789776648.009729:0:15028:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789776648.009897:0:15028:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1789776648.010196:0:15028:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789776648.010445:0:15028:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1789776648.010744:0:15028:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1789776648.011881:0:15028:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1789776648.070663:0:15028:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1789776648.070673:0:15028:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1789776648.070888:0:15028:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789776648.071017:0:15028:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.106@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789776648.071034:0:15028:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1789776648.071063:0:15028:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1789776648.916896:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789776649.879345:0:14344:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789776649.879352:0:14344:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c8688152000 from 7 10000000:01000000:1.0:1789776649.879357:0:14344:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789776649.879405:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c86bf5cb600/0x26940258de8f0239 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776649.879417:0:14344:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c86bf5cb600/0x26940258de8f0239 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776649.879429:0:14344:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c86bf5cb600/0x26940258de8f0239 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776649.879469:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14344:1876716471547392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789776649.879538:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776649.879586:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8683e66240 going to sleep for 11 seconds 00000100:00100000:2.0:1789776649.879734:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471547392 00000100:00100000:2.0:1789776649.879744:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471547392 00000100:00100000:2.0:1789776649.879797:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789776649.879807:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+15:14344:x1876716471547392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789776649.879819:0:14339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776649.879834:0:14339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c8686775800/0x26940258de8f0240 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8f0239 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776649.879875:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c8686775800/0x26940258de8f0240 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8f0239 expref: 16 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776649.879885:0:14339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c8686775800/0x26940258de8f0240 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8f0239 expref: 16 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776649.879893:0:14339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8686775800, rc 0) 00000100:00100000:2.0:1789776649.879942:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+16:14344:x1876716471547392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776649.879948:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789776649.884403:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14344:1876716471547392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789776649.884442:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c86bf5cb600/0x26940258de8f0239 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f0240 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776649.884455:0:14344:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c86bf5cb600/0x26940258de8f0239 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8f0240 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776649.884523:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14344:1876716471547520:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789776649.884586:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776649.884630:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bc8f6300 going to sleep for 11 seconds 00000100:00100000:1.0:1789776649.885578:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471547520 00000100:00100000:1.0:1789776649.885586:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471547520 00000100:00100000:1.0:1789776649.885628:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789776649.885639:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+16:14344:x1876716471547520:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789776649.885659:0:14341:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789776649.885676:0:14341:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789776649.885679:0:14341:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1789776649.885781:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+16:14344:x1876716471547520:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 143us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776649.885797:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789776649.887057:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14344:1876716471547520:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789776649.887128:0:14344:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789776649.887138:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c86bf5cb600/0x26940258de8f0239 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f0240 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776649.887149:0:14344:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c86bf5cb600/0x26940258de8f0239 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f0240 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776649.943469:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776650.968023:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776651.993287:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776653.012983:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789776653.212636:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789776653.212642:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789776653.212645:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789776653.212648:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789776653.212702:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3274:1876716471547776:0@lo:400:kworker.0 00000100:00100000:2.0:1789776653.212766:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776653.212816:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789776653.212822:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:3274:1876716471547648:0@lo:400:kworker.0 00000100:00100000:2.0:1789776653.212850:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776653.212879:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3275:1876716471547904:0@lo:400:kworker.0 00000100:00100000:2.0:1789776653.212903:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776653.212952:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471547776 00000100:00100000:2.0:1789776653.212960:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471547776 00000100:00100000:2.0:1789776653.212997:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471547904 00000100:00100000:2.0:1789776653.213000:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471547904 00000100:00100000:2.0:1789776653.213055:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789776653.213064:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1876716471547776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776653.213113:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1876716471547776:12345-0@lo:400:kworker.0 Request processed in 50us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776653.213120:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789776653.213136:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789776653.213142:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1876716471547904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776653.213172:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1876716471547904:12345-0@lo:400:kworker.0 Request processed in 30us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776653.213178:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789776653.213199:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471547648 00000100:00100000:2.0:1789776653.213203:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471547648 00000100:00100000:2.0:1789776653.213249:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789776653.213268:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+16:3274:x1876716471547648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776653.213298:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+16:3274:x1876716471547648:12345-0@lo:400:kworker.0 Request processed in 43us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776653.213304:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1789776653.213353:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c86ba6eaa00 x1876716471547904/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776653.213367:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3275:1876716471547904:0@lo:400:kworker.0 00000100:00100000:2.0:1789776653.213391:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:3274:1876716471547648:0@lo:400:kworker.0 00010000:00080000:2.0:1789776653.213401:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c86ba6eb100 x1876716471547776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776653.213408:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3274:1876716471547776:0@lo:400:kworker.0 00000100:00080000:1.0:1789776653.217312:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789776654.036463:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789776654.461493:0:15396:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789776655.060514:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776656.085096:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789776656.660984:0:14381:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789776657.108477:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776658.135423:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789776658.324356:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789776658.324364:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789776658.324367:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789776658.324370:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789776658.324422:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:3276:1876716471548032:0@lo:400:kworker.0 00000100:00100000:2.0:1789776658.324495:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776658.324565:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3273:1876716471548160:0@lo:400:kworker.0 00000100:00100000:2.0:1789776658.324593:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776658.324613:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789776658.324618:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3273:1876716471548288:0@lo:400:kworker.0 00000100:00100000:2.0:1789776658.324639:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776658.324672:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471548032 00000100:00100000:2.0:1789776658.324680:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471548032 00000100:00100000:2.0:1789776658.324726:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789776658.324747:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+16:3276:x1876716471548032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776658.324800:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+16:3276:x1876716471548032:12345-0@lo:400:kworker.0 Request processed in 54us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776658.325283:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789776658.325325:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471548160 00000100:00100000:2.0:1789776658.325329:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471548160 00000100:00100000:2.0:1789776658.325354:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471548288 00000100:00100000:2.0:1789776658.325357:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471548288 00000100:00100000:2.0:1789776658.325382:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789776658.325389:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1876716471548160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776658.325450:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1876716471548160:12345-0@lo:400:kworker.0 Request processed in 61us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776658.325456:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789776658.325467:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789776658.325473:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1876716471548288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776658.325498:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1876716471548288:12345-0@lo:400:kworker.0 Request processed in 25us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776658.325519:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789776658.325636:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c86ba6eaa00 x1876716471548288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776658.325651:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3273:1876716471548288:0@lo:400:kworker.0 00010000:00080000:2.0:1789776658.325661:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c86ba6e8e00 x1876716471548160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776658.325670:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3273:1876716471548160:0@lo:400:kworker.0 00000100:00100000:2.0:1789776658.325792:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:3276:1876716471548032:0@lo:400:kworker.0 00000100:00080000:0.0:1789776658.325985:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789776659.156431:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776659.221800:0:3272:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789776644/real 1789776644] req@ffff9c86b9e7ce00 x1876716471544192/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789776659 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776659.221830:0:3272:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c86b9e7ce00 x1876716471544192/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789776659 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776659.221840:0:3272:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789776644/real 1789776644] req@ffff9c86b9e7d180 x1876716471544320/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789776659 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776659.221868:0:3272:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c86b9e7d180 x1876716471544320/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789776659 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789776659.222204:0:3272:0:(import.c:65:import_set_state_nolock()) ffff9c86af405800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789776659.224108:0:3272:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789776659.224116:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3272:1876716471544192:0@lo:8:kworker.0 00000100:00080000:3.0:1789776659.224138:0:3272:0:(import.c:65:import_set_state_nolock()) ffff9c86b39ca800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789776659.228604:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789776659.228611:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789776659.228615:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c86af405800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789776659.228624:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 397 00000100:00080000:1.0:1789776659.228630:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789776659.228636:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c86af405800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1789776659.228657:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c86bf7bc380 x1876716471548544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789776659.228669:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789776659.228671:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789776659.228673:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c86b39ca800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789776659.228676:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 397 00000100:00080000:1.0:1789776659.228678:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789776659.228681:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c86b39ca800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1789776659.228691:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c86bf7bfb80 x1876716471548672/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789776659.228740:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876716471548800:0@lo:400:kworker.0 00000100:00100000:1.0:1789776659.228824:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776659.229067:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789776659.229085:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:3276:1876716471548416:0@lo:400:kworker.0 00000100:00100000:1.0:1789776659.229117:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776659.229155:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3273:1876716471548928:0@lo:400:kworker.0 00000100:00100000:1.0:1789776659.229186:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776659.229257:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471548800 00000100:00100000:1.0:1789776659.229265:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471548800 00000100:00100000:1.0:1789776659.229306:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471548928 00000100:00100000:1.0:1789776659.229309:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471548928 00000100:00100000:1.0:1789776659.229532:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789776659.229542:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876716471548800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776659.229597:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1876716471548800:12345-0@lo:400:kworker.0 Request processed in 57us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776659.229604:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789776659.229621:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789776659.229627:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1876716471548928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776659.229660:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1876716471548928:12345-0@lo:400:kworker.0 Request processed in 33us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776659.229665:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789776659.229683:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471548416 00000100:00100000:1.0:1789776659.229687:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471548416 00000100:00100000:1.0:1789776659.229710:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789776659.229716:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+16:3276:x1876716471548416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776659.229742:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+16:3276:x1876716471548416:12345-0@lo:400:kworker.0 Request processed in 26us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776659.229748:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1789776659.229792:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c86bf7bf480 x1876716471548928/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776659.229819:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3273:1876716471548928:0@lo:400:kworker.0 00000100:00100000:1.0:1789776659.229842:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:3276:1876716471548416:0@lo:400:kworker.0 00010000:00080000:1.0:1789776659.229851:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c86bf7bce00 x1876716471548800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776659.231276:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3276:1876716471548800:0@lo:400:kworker.0 00000100:00080000:3.0:1789776659.237121:0:3272:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789776659.237134:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3272:1876716471544320:0@lo:8:kworker.0 00000100:00100000:3.0:1789776659.237201:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3272:1876716471548544:0@lo:8:kworker.0 00000100:00100000:3.0:1789776659.237305:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776659.238113:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471548544 00000100:00100000:3.0:1789776659.238123:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471548544 00000100:00100000:3.0:1789776659.238161:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789776659.238169:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3272:x1876716471548544:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789776659.238197:0:15029:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 412 last 0 00000020:00000080:3.0:1789776659.238260:0:15029:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x26940258de8f0247 00002000:00100000:3.0:1789776659.238275:0:15029:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9c869892e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396f ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1789776659.238279:0:15029:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1789776659.238282:0:15029:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1789776659.239620:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3272:1876716471548672:0@lo:8:kworker.0 00000100:00100000:2.0:1789776659.239679:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776659.239988:0:15032:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789776659.239997:0:15032:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00002000:00080000:3.0:1789776659.241027:0:15029:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789776659.241064:0:15029:0:(import.c:65:import_set_state_nolock()) ffff9c869892a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789776659.241151:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3272:x1876716471548544:12345-0@lo:8:kworker.0 Request processed in 2980us (3845us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776659.241162:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789776659.241198:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471548672 00010000:00080000:0.0:1789776659.242301:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c86bf7bc380 x1876716471548544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789776679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789776659.242490:0:3272:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789776659.242502:0:3272:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789776659.242512:0:3272:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789776659.242519:0:3272:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789776659.242522:0:3272:0:(import.c:65:import_set_state_nolock()) ffff9c86af405800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789776659.242542:0:3272:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789776659.242548:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3272:1876716471548544:0@lo:8:kworker.0 00000100:00100000:3.0:1789776659.242833:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471548672 00000004:00080000:2.0:1789776659.243054:0:14370:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:2.0:1789776659.243076:0:14370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6eaa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14370:1876716471549184:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789776659.243133:0:14370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776659.243156:0:14370:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf1c4840 going to sleep for 11 seconds 00000004:00080000:2.0:1789776659.243173:0:14369:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1789776659.244027:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471549184 00000100:00100000:0.0:1789776659.244037:0:15031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471549184 00000100:00100000:3.0:1789776659.244107:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789776659.244120:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3272:x1876716471548672:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789776659.244137:0:15029:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789776659.244199:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3272:x1876716471548672:12345-0@lo:8:kworker.0 Request processed in 80us (4518us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789776659.244563:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789776659.244574:0:15031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14370:x1876716471549184:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789776659.244977:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789776659.245044:0:3272:0:(import.c:65:import_set_state_nolock()) ffff9c86b39ca800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789776659.245049:0:3272:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789776659.245053:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3272:1876716471548672:0@lo:8:kworker.0 00000100:00100000:3.0:1789776659.245100:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789776659.245112:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471549056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789776659.245157:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789776659.245250:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789776659.245283:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471549056 00000100:00100000:3.0:1789776659.245287:0:15033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471549056 00000100:00100000:3.0:1789776659.245333:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789776659.245342:0:15033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3273:x1876716471549056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789776659.245367:0:15033:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000004:00080000:2.0:1789776659.245808:0:14369:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 412025590362ns, next at 0ns, rc = 0 00000100:00100000:3.0:1789776659.247791:0:15033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3273:x1876716471549056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2442us (2624us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776659.247808:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789776659.248174:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c86ba6e8e00 x1876716471549056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776675 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776659.248196:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471549056:0@lo:13:osp-pre-0-0.0 00002000:00080000:0.0:1789776659.255864:0:15031:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1789776659.255877:0:15031:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1789776659.255882:0:15031:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:1.0:1789776659.285750:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789776659.285765:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2665e39/0x26940258de8f024e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.285783:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1789776659.285787:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776659.285793:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2665e39/0x26940258de8f024e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.285809:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2665e39/0x26940258de8f024e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.285818:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2665e39/0x26940258de8f024e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.285826:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2665e39/0x26940258de8f024e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.285845:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789776659.285868:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776659.285874:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2665e39/0x26940258de8f024e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.285882:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5cb400 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:1.0:1789776659.285887:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2665e39/0x26940258de8f024e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.285896:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2665e39/0x26940258de8f024e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.285912:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2665e39/0x26940258de8f024e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.285918:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2665e39/0x26940258de8f024e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.285938:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776659.285940:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776659.285942:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789776659.286895:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789776659.286903:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c0edeec/0x26940258de8f0255 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.286916:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1789776659.286920:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776659.286925:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c0edeec/0x26940258de8f0255 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.286947:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c0edeec/0x26940258de8f0255 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.286956:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c0edeec/0x26940258de8f0255 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.286964:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c0edeec/0x26940258de8f0255 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.286982:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789776659.286996:0:14335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776659.287001:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c0edeec/0x26940258de8f0255 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.288108:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5ca200 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:1.0:1789776659.288114:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c0edeec/0x26940258de8f0255 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.288125:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c0edeec/0x26940258de8f0255 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.288145:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c0edeec/0x26940258de8f0255 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.288152:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c0edeec/0x26940258de8f0255 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.288183:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776659.288185:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776659.288187:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789776659.290168:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789776659.290181:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cfc33d6/0x26940258de8f025c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.290199:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1789776659.290203:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776659.290236:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cfc33d6/0x26940258de8f025c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.290253:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cfc33d6/0x26940258de8f025c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.290263:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cfc33d6/0x26940258de8f025c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.290271:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cfc33d6/0x26940258de8f025c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.290295:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789776659.290310:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776659.290317:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cfc33d6/0x26940258de8f025c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.290342:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5cb800 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:1.0:1789776659.290347:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cfc33d6/0x26940258de8f025c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.290357:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cfc33d6/0x26940258de8f025c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.290374:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cfc33d6/0x26940258de8f025c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.290382:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cfc33d6/0x26940258de8f025c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.290403:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776659.290405:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776659.290406:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789776659.292146:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789776659.292158:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7e0d43c/0x26940258de8f0263 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.292172:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1789776659.292176:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776659.292181:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7e0d43c/0x26940258de8f0263 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.292193:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7e0d43c/0x26940258de8f0263 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.292232:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7e0d43c/0x26940258de8f0263 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.292240:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7e0d43c/0x26940258de8f0263 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.292258:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789776659.292269:0:14335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776659.292274:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7e0d43c/0x26940258de8f0263 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.292282:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5cba00 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:1.0:1789776659.292286:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7e0d43c/0x26940258de8f0263 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.292294:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7e0d43c/0x26940258de8f0263 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.292308:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7e0d43c/0x26940258de8f0263 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.292315:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7e0d43c/0x26940258de8f0263 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.292336:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776659.292343:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776659.292346:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789776659.293941:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789776659.293952:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000856758cf/0x26940258de8f026a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.293967:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1789776659.293970:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776659.293977:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000856758cf/0x26940258de8f026a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.293990:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000856758cf/0x26940258de8f026a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.293999:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000856758cf/0x26940258de8f026a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.294016:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000856758cf/0x26940258de8f026a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.294030:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789776659.294749:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789776659.294758:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000856758cf/0x26940258de8f026a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776659.294767:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5cb200 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:3.0:1789776659.294772:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000856758cf/0x26940258de8f026a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776659.294781:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000856758cf/0x26940258de8f026a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776659.294800:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000856758cf/0x26940258de8f026a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776659.294807:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000856758cf/0x26940258de8f026a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776659.294825:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776659.294827:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776659.294828:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789776659.295257:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789776659.295264:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a8a0975/0x26940258de8f0271 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.295274:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1789776659.295278:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776659.295283:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a8a0975/0x26940258de8f0271 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.295300:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a8a0975/0x26940258de8f0271 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.295309:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a8a0975/0x26940258de8f0271 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.295317:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a8a0975/0x26940258de8f0271 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.295845:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789776659.295858:0:14335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776659.295863:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a8a0975/0x26940258de8f0271 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.295871:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5cae00 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:1.0:1789776659.295875:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a8a0975/0x26940258de8f0271 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.295884:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a8a0975/0x26940258de8f0271 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.295898:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a8a0975/0x26940258de8f0271 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.295905:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a8a0975/0x26940258de8f0271 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.295928:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776659.295929:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776659.295931:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789776659.297168:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789776659.297177:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dd26b38/0x26940258de8f0278 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.297192:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1789776659.297197:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776659.297203:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008dd26b38/0x26940258de8f0278 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.297245:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008dd26b38/0x26940258de8f0278 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.297255:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dd26b38/0x26940258de8f0278 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.297262:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008dd26b38/0x26940258de8f0278 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.297278:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789776659.297286:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776659.297292:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008dd26b38/0x26940258de8f0278 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.297311:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5caa00 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:1.0:1789776659.297316:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008dd26b38/0x26940258de8f0278 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.297325:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008dd26b38/0x26940258de8f0278 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.297339:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008dd26b38/0x26940258de8f0278 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.297347:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008dd26b38/0x26940258de8f0278 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.297364:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776659.297366:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776659.297368:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789776659.297871:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789776659.297877:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebbe6508/0x26940258de8f027f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.297887:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1789776659.297891:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776659.297896:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebbe6508/0x26940258de8f027f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.297906:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebbe6508/0x26940258de8f027f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.297920:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebbe6508/0x26940258de8f027f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.297927:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ebbe6508/0x26940258de8f027f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.297941:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789776659.297950:0:14335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776659.297954:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ebbe6508/0x26940258de8f027f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.297961:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5ca400 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:1.0:1789776659.297965:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebbe6508/0x26940258de8f027f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.297972:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebbe6508/0x26940258de8f027f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.297983:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ebbe6508/0x26940258de8f027f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.297990:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebbe6508/0x26940258de8f027f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.298071:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776659.298078:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776659.298080:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789776659.298793:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789776659.298801:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001afed1bb/0x26940258de8f0286 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.298812:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1789776659.298815:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776659.298820:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001afed1bb/0x26940258de8f0286 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.298830:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001afed1bb/0x26940258de8f0286 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.298838:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001afed1bb/0x26940258de8f0286 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.298845:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001afed1bb/0x26940258de8f0286 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.298859:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789776659.298867:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776659.298871:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001afed1bb/0x26940258de8f0286 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.298879:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5ca800 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:1.0:1789776659.298883:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001afed1bb/0x26940258de8f0286 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.298903:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001afed1bb/0x26940258de8f0286 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.298918:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001afed1bb/0x26940258de8f0286 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.298926:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001afed1bb/0x26940258de8f0286 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.299839:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776659.299842:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776659.299844:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789776659.303708:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789776659.303722:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cfc33d6/0x26940258de8f028d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.303739:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1789776659.303743:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776659.303749:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cfc33d6/0x26940258de8f028d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.303763:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cfc33d6/0x26940258de8f028d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.303772:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cfc33d6/0x26940258de8f028d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.303786:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cfc33d6/0x26940258de8f028d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.303811:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789776659.304470:0:14335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789776659.304480:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cfc33d6/0x26940258de8f028d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776659.304489:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5cb800 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:0.0:1789776659.304494:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cfc33d6/0x26940258de8f028d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776659.304513:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cfc33d6/0x26940258de8f028d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776659.304533:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cfc33d6/0x26940258de8f028d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776659.304541:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cfc33d6/0x26940258de8f028d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776659.304562:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776659.304563:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776659.304565:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789776659.305116:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789776659.305123:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c0edeec/0x26940258de8f0294 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.305135:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1789776659.305139:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776659.305145:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c0edeec/0x26940258de8f0294 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.305156:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c0edeec/0x26940258de8f0294 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.305164:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c0edeec/0x26940258de8f0294 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.305171:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c0edeec/0x26940258de8f0294 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.305185:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789776659.305195:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776659.305199:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c0edeec/0x26940258de8f0294 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.305249:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5ca200 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:1.0:1789776659.305253:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c0edeec/0x26940258de8f0294 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.305261:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c0edeec/0x26940258de8f0294 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.305274:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c0edeec/0x26940258de8f0294 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.305281:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c0edeec/0x26940258de8f0294 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.305297:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776659.305299:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776659.305300:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789776659.305727:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789776659.305734:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2665e39/0x26940258de8f029b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.305743:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1789776659.305747:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776659.305751:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2665e39/0x26940258de8f029b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.305759:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2665e39/0x26940258de8f029b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.305772:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2665e39/0x26940258de8f029b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.305779:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2665e39/0x26940258de8f029b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.305791:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789776659.305869:0:14335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789776659.305875:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2665e39/0x26940258de8f029b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776659.305883:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5cb400 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:0.0:1789776659.305902:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2665e39/0x26940258de8f029b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776659.305911:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2665e39/0x26940258de8f029b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776659.305923:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2665e39/0x26940258de8f029b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776659.305941:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2665e39/0x26940258de8f029b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776659.305958:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776659.305960:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776659.305961:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789776659.307078:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789776659.307086:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a8a0975/0x26940258de8f02a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.307098:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1789776659.307102:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776659.307107:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a8a0975/0x26940258de8f02a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.307118:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a8a0975/0x26940258de8f02a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.307126:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a8a0975/0x26940258de8f02a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.307132:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a8a0975/0x26940258de8f02a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.307167:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789776659.307501:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789776659.307510:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a8a0975/0x26940258de8f02a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776659.307519:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5cae00 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:0.0:1789776659.307523:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a8a0975/0x26940258de8f02a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776659.307531:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a8a0975/0x26940258de8f02a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776659.307548:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a8a0975/0x26940258de8f02a2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776659.307556:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a8a0975/0x26940258de8f02a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776659.307574:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776659.307576:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776659.307577:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789776659.307661:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789776659.307666:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7e0d43c/0x26940258de8f02a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.307676:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1789776659.307679:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776659.307683:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7e0d43c/0x26940258de8f02a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.307692:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7e0d43c/0x26940258de8f02a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.307699:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7e0d43c/0x26940258de8f02a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.307706:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7e0d43c/0x26940258de8f02a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.307728:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789776659.308070:0:14335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789776659.308076:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7e0d43c/0x26940258de8f02a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776659.308084:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5cba00 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:0.0:1789776659.308087:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7e0d43c/0x26940258de8f02a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776659.308094:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7e0d43c/0x26940258de8f02a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776659.308105:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7e0d43c/0x26940258de8f02a9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776659.308111:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7e0d43c/0x26940258de8f02a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776659.308127:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776659.308129:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776659.308130:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789776659.311765:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789776659.311777:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026f0d185/0x26940258de8f02b0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.311793:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1789776659.311803:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776659.311810:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026f0d185/0x26940258de8f02b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.311823:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026f0d185/0x26940258de8f02b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.311833:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026f0d185/0x26940258de8f02b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.311840:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026f0d185/0x26940258de8f02b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.311866:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789776659.312597:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776659.312616:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026f0d185/0x26940258de8f02b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776659.312625:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5cbc00 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:2.0:1789776659.312629:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026f0d185/0x26940258de8f02b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776659.312638:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026f0d185/0x26940258de8f02b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776659.312659:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026f0d185/0x26940258de8f02b0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776659.312667:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026f0d185/0x26940258de8f02b0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776659.312692:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776659.312694:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776659.312696:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789776659.313802:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789776659.313813:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c0edeec/0x26940258de8f02b7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.313829:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1789776659.313832:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776659.313838:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c0edeec/0x26940258de8f02b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.313851:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c0edeec/0x26940258de8f02b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.313860:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c0edeec/0x26940258de8f02b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.313877:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c0edeec/0x26940258de8f02b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.317523:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789776659.317838:0:14335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789776659.317848:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c0edeec/0x26940258de8f02b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776659.317869:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5ca200 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:0.0:1789776659.317874:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c0edeec/0x26940258de8f02b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776659.317905:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c0edeec/0x26940258de8f02b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776659.317926:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c0edeec/0x26940258de8f02b7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776659.317934:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c0edeec/0x26940258de8f02b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776659.317959:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776659.317960:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776659.317962:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789776659.318781:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789776659.318790:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001afed1bb/0x26940258de8f02be lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.318804:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1789776659.318809:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776659.318816:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001afed1bb/0x26940258de8f02be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.318828:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001afed1bb/0x26940258de8f02be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.318850:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001afed1bb/0x26940258de8f02be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.318859:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001afed1bb/0x26940258de8f02be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.318888:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789776659.319023:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789776659.319030:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001afed1bb/0x26940258de8f02be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776659.319038:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5ca800 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:0.0:1789776659.319042:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001afed1bb/0x26940258de8f02be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776659.319050:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001afed1bb/0x26940258de8f02be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776659.319064:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001afed1bb/0x26940258de8f02be lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776659.319085:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001afed1bb/0x26940258de8f02be lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776659.319106:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776659.319108:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776659.319110:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789776659.321522:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789776659.321535:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebbe6508/0x26940258de8f02c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.321558:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1789776659.321562:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776659.321568:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebbe6508/0x26940258de8f02c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.321580:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebbe6508/0x26940258de8f02c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.321589:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebbe6508/0x26940258de8f02c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.321596:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ebbe6508/0x26940258de8f02c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.321620:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789776659.322744:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789776659.322753:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dd26b38/0x26940258de8f02cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.322765:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1789776659.322768:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776659.322774:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008dd26b38/0x26940258de8f02cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.322784:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008dd26b38/0x26940258de8f02cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.322801:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dd26b38/0x26940258de8f02cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.322808:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008dd26b38/0x26940258de8f02cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.322825:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789776659.322836:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789776659.322859:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ebbe6508/0x26940258de8f02c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.322867:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5ca400 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:1.0:1789776659.322872:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebbe6508/0x26940258de8f02c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.322880:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebbe6508/0x26940258de8f02c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.322896:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ebbe6508/0x26940258de8f02c5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.324229:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebbe6508/0x26940258de8f02c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.324262:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776659.324274:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008dd26b38/0x26940258de8f02cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.324283:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5caa00 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:1.0:1789776659.324286:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008dd26b38/0x26940258de8f02cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.324296:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008dd26b38/0x26940258de8f02cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.324313:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008dd26b38/0x26940258de8f02cc lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.324320:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008dd26b38/0x26940258de8f02cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.324333:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776659.324335:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776659.324337:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789776659.325705:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789776659.325714:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002210f05f/0x26940258de8f02d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.325729:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1789776659.325732:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776659.325738:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002210f05f/0x26940258de8f02d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.325762:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002210f05f/0x26940258de8f02d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.325772:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002210f05f/0x26940258de8f02d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.325779:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002210f05f/0x26940258de8f02d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.325804:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789776659.328186:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789776659.328197:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000856758cf/0x26940258de8f02da lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.328245:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1789776659.328249:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776659.328256:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000856758cf/0x26940258de8f02da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.328268:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000856758cf/0x26940258de8f02da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.328277:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000856758cf/0x26940258de8f02da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.328295:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000856758cf/0x26940258de8f02da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.328305:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789776659.328562:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789776659.328571:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002210f05f/0x26940258de8f02d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776659.328580:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5cbe00 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:2.0:1789776659.328586:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002210f05f/0x26940258de8f02d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776659.328622:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002210f05f/0x26940258de8f02d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776659.328640:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002210f05f/0x26940258de8f02d3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776659.328648:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002210f05f/0x26940258de8f02d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776659.328671:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776659.328675:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000856758cf/0x26940258de8f02da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776659.328682:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5cb200 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:2.0:1789776659.328685:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000856758cf/0x26940258de8f02da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776659.328693:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000856758cf/0x26940258de8f02da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776659.328704:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000856758cf/0x26940258de8f02da lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776659.328711:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000856758cf/0x26940258de8f02da lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776659.328739:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776659.328741:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776659.328743:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789776659.329696:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789776659.329703:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c052fe8b/0x26940258de8f02e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.329716:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1789776659.329720:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776659.329726:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c052fe8b/0x26940258de8f02e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.329737:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c052fe8b/0x26940258de8f02e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.329745:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c052fe8b/0x26940258de8f02e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.329752:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c052fe8b/0x26940258de8f02e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.329773:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789776659.329785:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776659.329790:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c052fe8b/0x26940258de8f02e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.329802:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8680030400 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:1.0:1789776659.329806:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c052fe8b/0x26940258de8f02e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.329814:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c052fe8b/0x26940258de8f02e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.329827:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c052fe8b/0x26940258de8f02e1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.329833:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c052fe8b/0x26940258de8f02e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.329847:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776659.329849:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776659.329850:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789776659.332173:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789776659.332184:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a19dfbaa/0x26940258de8f02e8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.332200:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1789776659.332247:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776659.332254:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a19dfbaa/0x26940258de8f02e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.332268:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a19dfbaa/0x26940258de8f02e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.332283:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a19dfbaa/0x26940258de8f02e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.332291:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a19dfbaa/0x26940258de8f02e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.332314:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789776659.332331:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776659.332337:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a19dfbaa/0x26940258de8f02e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.332345:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8680030a00 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:1.0:1789776659.332350:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a19dfbaa/0x26940258de8f02e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.332359:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a19dfbaa/0x26940258de8f02e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.332376:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a19dfbaa/0x26940258de8f02e8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.332383:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a19dfbaa/0x26940258de8f02e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.332400:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776659.332407:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776659.332469:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776659.332746:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789776659.332916:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789776659.332922:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d939f933/0x26940258de8f02ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.332932:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1789776659.332935:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776659.332939:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d939f933/0x26940258de8f02ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.332948:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d939f933/0x26940258de8f02ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.332957:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d939f933/0x26940258de8f02ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.332964:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d939f933/0x26940258de8f02ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.332987:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789776659.333749:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789776659.333758:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d939f933/0x26940258de8f02ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776659.333769:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8680030800 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:0.0:1789776659.333774:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d939f933/0x26940258de8f02ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776659.333784:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d939f933/0x26940258de8f02ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776659.333800:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d939f933/0x26940258de8f02ef lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776659.333808:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d939f933/0x26940258de8f02ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776659.333828:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776659.333829:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776659.333838:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789776659.334090:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:1.0:1789776659.335860:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789776659.335872:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef96afc4/0x26940258de8f02f6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.335887:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1789776659.335892:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776659.335898:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef96afc4/0x26940258de8f02f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.335919:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef96afc4/0x26940258de8f02f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.335930:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef96afc4/0x26940258de8f02f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.335937:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef96afc4/0x26940258de8f02f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.335967:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789776659.336170:0:14335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789776659.336178:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef96afc4/0x26940258de8f02f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776659.336187:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8680030600 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:0.0:1789776659.336191:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef96afc4/0x26940258de8f02f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776659.336201:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef96afc4/0x26940258de8f02f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776659.336244:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef96afc4/0x26940258de8f02f6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776659.336251:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef96afc4/0x26940258de8f02f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776659.336271:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776659.336272:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776659.336274:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789776659.337764:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789776659.337774:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c251760/0x26940258de8f02fd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.337791:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1789776659.337795:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776659.337801:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c251760/0x26940258de8f02fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.337813:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c251760/0x26940258de8f02fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.337822:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c251760/0x26940258de8f02fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.337844:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c251760/0x26940258de8f02fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.338494:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789776659.339096:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789776659.339104:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a78eb8bf/0x26940258de8f0304 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.339118:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1789776659.339122:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776659.339128:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a78eb8bf/0x26940258de8f0304 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.339139:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a78eb8bf/0x26940258de8f0304 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.339147:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a78eb8bf/0x26940258de8f0304 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776659.339154:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a78eb8bf/0x26940258de8f0304 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776659.342499:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789776659.342515:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c251760/0x26940258de8f02fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776659.342529:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8680031c00 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:2.0:1789776659.342535:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c251760/0x26940258de8f02fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776659.342547:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c251760/0x26940258de8f02fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776659.342569:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c251760/0x26940258de8f02fd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776659.342577:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c251760/0x26940258de8f02fd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776659.342600:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776659.343060:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a78eb8bf/0x26940258de8f0304 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776659.343070:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8680031600 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:2.0:1789776659.343082:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a78eb8bf/0x26940258de8f0304 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776659.343091:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a78eb8bf/0x26940258de8f0304 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776659.343103:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a78eb8bf/0x26940258de8f0304 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776659.343112:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776659.343114:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776659.343116:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776659.343262:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789776659.343269:0:15031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a78eb8bf/0x26940258de8f0304 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776659.343476:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1789776659.343631:0:15031:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:1.0:1789776659.343725:0:15031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14370:x1876716471549184:12345-0@lo:5:osp-pre-0-0.0 Request processed in 99151us (100587us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776659.343737:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789776659.344745:0:14370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6eaa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14370:1876716471549184:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789776659.344764:0:14370:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:2.0:1789776659.344814:0:14370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6eaa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14370:1876716471549312:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789776659.345366:0:14370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776659.345433:0:14370:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86910306c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776659.345534:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471549312 00000100:00100000:0.0:1789776659.345541:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471549312 00000100:00100000:0.0:1789776659.345597:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789776659.345614:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14370:x1876716471549312:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1789776659.345658:0:15029:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:2.0:1789776659.354834:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14370:x1876716471549312:12345-0@lo:5:osp-pre-0-0.0 Request processed in 9222us (9462us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789776659.354851:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789776659.355090:0:14370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6eaa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14370:1876716471549312:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789776659.355108:0:14370:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:2.0:1789776660.183708:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789776661.162736:0:15748:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789776661.162740:0:15748:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1789776661.162855:0:15748:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c86beb07800 00000020:01000004:1.0:1789776661.162873:0:15748:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1789776661.163129:0:15748:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1789776661.163145:0:15748:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9c86bab60000) 00000020:00000080:1.0:1789776661.163163:0:15748:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789776661.187420:0:15748:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1789776661.187790:0:15748:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1789776661.189286:0:15748:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1789776661.189520:0:15748:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1789776661.189880:0:15748:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1789776661.190406:0:15748:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 641: rc = 0 00100000:10000000:0.0:1789776661.190508:0:15748:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 641: rc = 0 00100000:10000000:0.0:1789776661.190618:0:15748:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 641: rc = 0 00100000:10000000:0.0:1789776661.191466:0:15748:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 477: rc = 0 00100000:10000000:0.0:1789776661.191792:0:15748:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 477: rc = 0 00100000:10000000:0.0:1789776661.195386:0:15748:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 477: rc = 0 00100000:10000000:0.0:1789776661.195798:0:15748:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 477: rc = 0 00100000:10000000:0.0:1789776661.196353:0:15748:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 477: rc = 0 00100000:10000000:0.0:1789776661.196794:0:15748:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 477: rc = 0 00000020:00000080:0.0:1789776661.198113:0:15748:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1789776661.198127:0:15748:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789776661.198139:0:15748:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x26940258de8f0312 00000020:01000004:0.0:1789776661.198148:0:15748:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1789776661.198170:0:15748:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.106@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789776661.198174:0:15748:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789776661.198179:0:15748:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1789776661.198317:0:15748:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1789776661.198323:0:15748:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.106@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00010000:00010000:2.0:1789776661.208378:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1789776661.217672:0:15748:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.106@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789776661.217722:0:15748:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.106@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1789776661.217727:0:15748:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789776661.217728:0:15748:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789776661.217730:0:15748:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789776661.217731:0:15748:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789776661.217732:0:15748:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789776661.217734:0:15748:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789776661.217735:0:15748:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789776661.217737:0:15748:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789776661.217738:0:15748:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789776661.217742:0:15748:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1789776661.217744:0:15748:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789776661.217745:0:15748:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789776661.217746:0:15748:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789776661.217748:0:15748:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789776661.217749:0:15748:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789776661.217750:0:15748:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789776661.217751:0:15748:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789776661.217752:0:15748:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789776661.217753:0:15748:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789776661.217778:0:15748:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789776661.217804:0:15748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15748:1876716471549440:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789776661.217947:0:15748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776661.218060:0:15748:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86a03ae780 going to sleep for 11 seconds 00000100:00100000:2.0:1789776661.218123:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471549440 00000100:00100000:2.0:1789776661.218131:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471549440 00000100:00100000:2.0:1789776661.218305:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789776661.218316:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+16:15748:x1876716471549440:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789776661.218353:0:14342:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789776661.218357:0:14342:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1789776661.218361:0:14342:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789776661.231089:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+16:15748:x1876716471549440:12345-0@lo:253:mount.lustre.0 Request processed in 12766us (13134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776661.231103:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789776661.231201:0:15748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15748:1876716471549440:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789776661.231337:0:15748:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789776661.231341:0:15748:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789776661.231343:0:15748:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789776661.231344:0:15748:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789776661.231345:0:15748:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789776661.231347:0:15748:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789776661.231348:0:15748:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789776661.231349:0:15748:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789776661.231351:0:15748:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789776661.231352:0:15748:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789776661.231373:0:15748:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c86beb07800 from lustre-OST0001 10000000:01000000:1.0:1789776661.231399:0:15748:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1789776661.231401:0:15748:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789776661.231408:0:15748:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c86b9903370 local copy 00010000:00010000:1.0:1789776661.231418:0:15748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8686775a00/0x26940258de8f00bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f00c6 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776661.231711:0:15748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15748:1876716471549568:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789776661.231748:0:15748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776661.231787:0:15748:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86b9e51540 going to sleep for 11 seconds 00000100:00100000:2.0:1789776661.231853:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471549568 00000100:00100000:2.0:1789776661.231860:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471549568 00000100:00100000:2.0:1789776661.231904:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789776661.231912:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+16:15748:x1876716471549568:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789776661.232162:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+16:15748:x1876716471549568:12345-0@lo:501:mount.lustre.0 Request processed in 250us (412us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789776661.232169:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789776661.232340:0:15748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15748:1876716471549568:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789776661.232354:0:15748:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789776661.232484:0:15748:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789776661.232496:0:15748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8686775a00/0x26940258de8f00bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f00c6 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776661.232505:0:15748:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c8686775a00/0x26940258de8f00bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f00c6 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776661.232527:0:15748:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c86beb07800 10000000:01000000:3.0:1789776661.232531:0:15748:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789776661.232535:0:15748:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789776661.232537:0:15748:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789776661.232541:0:15748:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789776661.232544:0:15748:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789776661.232568:0:15748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8681679800/0x26940258de8f0319 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776661.232576:0:15748:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c8681679800/0x26940258de8f0319 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776661.232597:0:15748:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c8681679800/0x26940258de8f0319 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776661.232611:0:15748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15748:1876716471549696:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789776661.232644:0:15748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776661.232673:0:15748:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86987b56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776661.232802:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471549696 00000100:00100000:1.0:1789776661.232807:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471549696 00000100:00100000:1.0:1789776661.232844:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789776661.232851:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+16:15748:x1876716471549696:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789776661.232860:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776661.232872:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c8680031400/0x26940258de8f0320 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8f0319 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776661.232932:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c8680031400/0x26940258de8f0320 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8f0319 expref: 17 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776661.232944:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c8680031400/0x26940258de8f0320 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8f0319 expref: 17 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776661.232953:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8680031400, rc 0) 00000100:00100000:1.0:1789776661.232985:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+17:15748:x1876716471549696:12345-0@lo:101:mount.lustre.0 Request processed in 134us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776661.232991:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789776661.233160:0:15748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15748:1876716471549696:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789776661.233174:0:15748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c8681679800/0x26940258de8f0319 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f0320 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776661.233183:0:15748:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c8681679800/0x26940258de8f0319 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8f0320 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789776661.233960:0:15748:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1789776661.235170:0:15748:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789776661.235575:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1789776661.235802:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1789776661.235839:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1789776661.235924:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1789776661.235964:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1789776661.236001:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1789776661.236072:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1789776661.236080:0:15748:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1789776661.236173:0:15748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15748:1876716471549824:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789776661.236286:0:15748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776661.236327:0:15748:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86987b5c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789776661.236835:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471549824 00000100:00100000:1.0:1789776661.236842:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471549824 00000100:00100000:1.0:1789776661.236902:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789776661.236912:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+17:15748:x1876716471549824:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789776661.237438:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+17:15748:x1876716471549824:12345-0@lo:501:mount.lustre.0 Request processed in 526us (1151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776661.237446:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789776661.237755:0:15748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15748:1876716471549824:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789776661.237803:0:15748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15748:1876716471549952:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789776661.237850:0:15748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776661.237890:0:15748:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86987b5c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789776661.238161:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471549952 00000100:00100000:1.0:1789776661.238167:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471549952 00000100:00100000:1.0:1789776661.238251:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789776661.238261:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+17:15748:x1876716471549952:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789776661.238717:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+17:15748:x1876716471549952:12345-0@lo:503:mount.lustre.0 Request processed in 456us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776661.238724:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789776661.238818:0:15748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15748:1876716471549952:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789776661.239555:0:15748:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789776661.239980:0:15748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15748:1876716471550080:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789776661.240048:0:15748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776661.240154:0:15748:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf128a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789776661.240486:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471550080 00000100:00100000:0.0:1789776661.240493:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471550080 00000100:00100000:3.0:1789776661.240701:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789776661.240713:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+17:15748:x1876716471550080:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789776661.241007:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+17:15748:x1876716471550080:12345-0@lo:502:mount.lustre.0 Request processed in 296us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776661.241023:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789776661.241107:0:15748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15748:1876716471550080:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789776661.241429:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1789776661.241481:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1789776661.241512:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1789776661.241557:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1789776661.241604:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1789776661.241637:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1789776661.241682:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1789776661.241715:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1789776661.241759:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1789776661.241793:0:15748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7bf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15748:1876716471550208:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789776661.241841:0:15748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776661.242518:0:15748:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86b9e51480 going to sleep for 11 seconds 00000100:00100000:0.0:1789776661.242654:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471550208 00000100:00100000:0.0:1789776661.242663:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471550208 00000100:00100000:2.0:1789776661.242827:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789776661.242838:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+17:15748:x1876716471550208:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789776661.243391:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+17:15748:x1876716471550208:12345-0@lo:502:mount.lustre.0 Request processed in 554us (1549us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776661.243400:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789776661.243508:0:15748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7bf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15748:1876716471550208:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789776661.243685:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1789776661.243700:0:15748:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1789776661.245212:0:15749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789776661.245308:0:15749:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1789776661.245392:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789776661.245396:0:15749:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789776661.245405:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789776661.245421:0:15749:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9c86bb964d28) 00000020:00000080:3.0:1789776661.245447:0:15749:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789776661.245453:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789776661.245535:0:15749:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c86beb07800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789776661.245543:0:15749:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789776661.245550:0:15749:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x26940258de8f032e 00010000:00010000:3.0:1789776661.250662:0:15749:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1789776661.251375:0:15749:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1789776661.255029:0:15749:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1789776661.256744:0:15749:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1789776661.256756:0:15749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789776661.256763:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776661.256766:0:15749:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1789776661.256770:0:15749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789776661.256773:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776661.256774:0:15749:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789776661.256777:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789776661.256779:0:15749:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789776661.256781:0:15749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789776661.256783:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776661.256784:0:15749:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789776661.256786:0:15749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789776661.256788:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776661.256789:0:15749:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789776661.256792:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789776661.257107:0:15749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789776661.257111:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789776661.257113:0:15749:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789776661.257116:0:15749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1789776661.257685:0:15748:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1789776661.257718:0:15748:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789776661.257742:0:15748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8681679800/0x26940258de8f0319 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f0320 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776661.257755:0:15748:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c8681679800/0x26940258de8f0319 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f0320 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789776661.257764:0:15748:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c86beb07800 from 1 10000000:01000000:3.0:1789776661.257767:0:15748:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789776661.257805:0:15748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8681679200/0x26940258de8f0335 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776661.257814:0:15748:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c8681679200/0x26940258de8f0335 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776661.257825:0:15748:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c8681679200/0x26940258de8f0335 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776661.257871:0:15748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15748:1876716471550336:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789776661.259021:0:15748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776661.259073:0:15748:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf128c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789776661.259157:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471550336 00000100:00100000:2.0:1789776661.259166:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471550336 00000100:00100000:2.0:1789776661.259247:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789776661.259257:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c868634fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+17:15748:x1876716471550336:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789776661.259272:0:14339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776661.259291:0:14339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c8686775000/0x26940258de8f033c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8f0335 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776661.259319:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c8686775000/0x26940258de8f033c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8f0335 expref: 18 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776661.259345:0:14339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c8686775000/0x26940258de8f033c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8f0335 expref: 18 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776661.259354:0:14339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8686775000, rc 0) 00000100:00100000:2.0:1789776661.259395:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c868634fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+18:15748:x1876716471550336:12345-0@lo:101:mount.lustre.0 Request processed in 139us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776661.259402:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789776661.259533:0:15748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15748:1876716471550336:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789776661.259550:0:15748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c8681679200/0x26940258de8f0335 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f033c expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776661.259559:0:15748:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c8681679200/0x26940258de8f0335 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8f033c expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789776661.262067:0:15748:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789776661.263406:0:15748:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789776661.263819:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789776661.264037:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789776661.264114:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789776661.264124:0:15748:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789776661.264326:0:15748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15748:1876716471550464:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789776661.264400:0:15748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776661.264443:0:15748:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf128c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789776661.267689:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471550464 00000100:00100000:2.0:1789776661.267705:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471550464 00000100:00100000:2.0:1789776661.267765:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789776661.267776:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c868634d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+18:15748:x1876716471550464:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789776661.268298:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c868634d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+18:15748:x1876716471550464:12345-0@lo:501:mount.lustre.0 Request processed in 523us (3896us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776661.268307:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789776661.268411:0:15748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15748:1876716471550464:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789776661.268461:0:15748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15748:1876716471550592:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789776661.268508:0:15748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776661.268545:0:15748:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf128c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789776661.268664:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471550592 00000100:00100000:2.0:1789776661.268669:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471550592 00000100:00100000:2.0:1789776661.268705:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789776661.268713:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c868634f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+18:15748:x1876716471550592:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789776661.269147:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c868634f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+18:15748:x1876716471550592:12345-0@lo:503:mount.lustre.0 Request processed in 434us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776661.269151:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789776661.269329:0:15748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15748:1876716471550592:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789776661.270707:0:15748:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789776661.270796:0:15748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15748:1876716471550720:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789776661.270998:0:15748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776661.271096:0:15748:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf128c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789776661.271157:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471550720 00000100:00100000:2.0:1789776661.271164:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471550720 00000100:00100000:2.0:1789776661.271289:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789776661.271299:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bae15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+18:15748:x1876716471550720:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789776661.271533:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bae15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+18:15748:x1876716471550720:12345-0@lo:502:mount.lustre.0 Request processed in 235us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776661.271548:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789776661.271751:0:15748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15748:1876716471550720:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789776661.272108:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789776661.272163:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1789776661.273070:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1789776661.273131:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1789776661.273170:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1789776661.273304:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1789776661.273371:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1789776661.273407:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1789776661.273453:0:15748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15748:1876716471550848:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789776661.273519:0:15748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776661.273661:0:15748:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf128c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789776661.273749:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471550848 00000100:00100000:2.0:1789776661.273757:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471550848 00000100:00100000:2.0:1789776661.273797:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789776661.273805:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bae14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+18:15748:x1876716471550848:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789776661.274028:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bae14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+18:15748:x1876716471550848:12345-0@lo:502:mount.lustre.0 Request processed in 222us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776661.274035:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789776661.274260:0:15748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15748:1876716471550848:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789776661.274374:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1789776661.274384:0:15748:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1789776661.275304:0:15753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789776661.275315:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776661.275318:0:15753:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789776661.275324:0:15753:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c86beb07800 00000020:00000080:0.0:1789776661.275326:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789776661.275333:0:15753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789776661.275335:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776661.275336:0:15753:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789776661.275338:0:15753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789776661.275341:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776661.275342:0:15753:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789776661.275345:0:15753:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c86beb07800 00000020:00000080:0.0:1789776661.275347:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789776661.275402:0:15753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789776661.275405:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776661.275407:0:15753:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789776661.275410:0:15753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789776661.275412:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776661.275413:0:15753:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789776661.275417:0:15753:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c86beb07800 00000020:00000080:0.0:1789776661.275420:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789776661.275455:0:15753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789776661.275458:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789776661.275459:0:15753:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789776661.275462:0:15753:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1789776661.275600:0:15748:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1789776661.275624:0:15748:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789776661.275647:0:15748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8681679200/0x26940258de8f0335 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f033c expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776661.275657:0:15748:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c8681679200/0x26940258de8f0335 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f033c expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776661.275695:0:15748:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789776661.275698:0:15748:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c86beb07800 10000000:01000000:2.0:1789776661.275701:0:15748:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c86beb07800 10000000:01000000:2.0:1789776661.275704:0:15748:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789776661.275709:0:15748:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c86beb07800 from 1 10000000:01000000:2.0:1789776661.275712:0:15748:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789776661.275741:0:15748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8686774a00/0x26940258de8f0343 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776661.275748:0:15748:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c8686774a00/0x26940258de8f0343 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776661.275757:0:15748:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c8686774a00/0x26940258de8f0343 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776661.275783:0:15748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15748:1876716471550976:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789776661.275834:0:15748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776661.275998:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471550976 00000100:00100000:2.0:1789776661.276004:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471550976 00000100:00100000:2.0:1789776661.276038:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789776661.276046:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bae17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+18:15748:x1876716471550976:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789776661.276059:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776661.276071:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c8686775e00/0x26940258de8f034a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8f0343 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776661.276094:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c8686775e00/0x26940258de8f034a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8f0343 expref: 19 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776661.276105:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c8686775e00/0x26940258de8f034a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8f0343 expref: 19 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776661.276113:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8686775e00, rc 0) 00000100:00100000:2.0:1789776661.276142:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bae17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+19:15748:x1876716471550976:12345-0@lo:101:mount.lustre.0 Request processed in 96us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776661.276149:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789776661.276185:0:15748:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf22b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789776661.276238:0:15748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15748:1876716471550976:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789776661.276253:0:15748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c8686774a00/0x26940258de8f0343 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f034a expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776661.276262:0:15748:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c8686774a00/0x26940258de8f0343 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8f034a expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789776661.280048:0:15748:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1789776661.280526:0:15748:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789776661.280811:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1789776661.283080:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1789776661.283160:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1789776661.283712:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1789776661.283760:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1789776661.283812:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1789776661.283846:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1789776661.283875:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1789776661.284069:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1789776661.284107:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1789776661.284141:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1789776661.284187:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1789776661.284257:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1789776661.284290:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1789776661.284335:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1789776661.284392:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1789776661.284425:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1789776661.284474:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1789776661.284509:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1789776661.284542:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1789776661.287097:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1789776661.287742:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1789776661.288324:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1789776661.288411:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1789776661.288450:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1789776661.288485:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1789776661.288533:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1789776661.288569:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1789776661.289166:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1789776661.289728:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1789776661.289758:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1789776661.289805:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1789776661.289837:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1789776661.290296:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1789776661.290333:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1789776661.290377:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1789776661.290411:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1789776661.290508:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1789776661.290516:0:15748:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1789776661.290615:0:15748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15748:1876716471551104:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789776661.290679:0:15748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776661.290835:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471551104 00000100:00100000:2.0:1789776661.290843:0:15748:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf22b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776661.291009:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471551104 00000100:00100000:0.0:1789776661.291062:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789776661.291073:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bae14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+19:15748:x1876716471551104:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789776661.291360:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bae14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+19:15748:x1876716471551104:12345-0@lo:501:mount.lustre.0 Request processed in 288us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776661.291368:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789776661.291396:0:15748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15748:1876716471551104:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789776661.291430:0:15748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15748:1876716471551232:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789776661.291468:0:15748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776661.291497:0:15748:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf22b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789776661.291674:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471551232 00000100:00100000:3.0:1789776661.291678:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471551232 00000100:00100000:3.0:1789776661.291704:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789776661.291710:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bae15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+19:15748:x1876716471551232:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789776661.292004:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bae15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+19:15748:x1876716471551232:12345-0@lo:503:mount.lustre.0 Request processed in 293us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776661.292011:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789776661.292083:0:15748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15748:1876716471551232:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789776661.292649:0:15748:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789776661.292711:0:15748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15748:1876716471551360:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789776661.292750:0:15748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776661.292790:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471551360 00000100:00100000:2.0:1789776661.292794:0:15748:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf22b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776661.292795:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471551360 00000100:00100000:0.0:1789776661.292820:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789776661.292827:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bae14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+19:15748:x1876716471551360:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789776661.293428:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bae14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+19:15748:x1876716471551360:12345-0@lo:502:mount.lustre.0 Request processed in 599us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776661.293436:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789776661.296779:0:15748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15748:1876716471551360:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789776661.298002:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789776661.298077:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1789776661.298135:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1789776661.298187:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1789776661.301784:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1789776661.301964:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1789776661.302009:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1789776661.302043:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1789776661.302097:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789776661.302132:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1789776661.302164:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1789776661.302528:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1789776661.302572:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1789776661.303296:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1789776661.303355:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1789776661.303391:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1789776661.303423:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1789776661.303473:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1789776661.303533:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1789776661.303567:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1789776661.304825:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1789776661.305783:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1789776661.306326:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1789776661.306418:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1789776661.306456:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1789776661.306493:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1789776661.306557:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1789776661.307631:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1789776661.307676:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1789776661.307733:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1789776661.307768:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1789776661.307804:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1789776661.307840:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1789776661.307890:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1789776661.307947:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1789776661.307999:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1789776661.308037:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1789776661.308071:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1789776661.308120:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1789776661.308154:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1789776661.308499:0:15748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7bf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15748:1876716471551488:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789776661.308596:0:15748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776661.308650:0:15748:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86906b4300 going to sleep for 11 seconds 00000100:00100000:2.0:1789776661.308773:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471551488 00000100:00100000:2.0:1789776661.308780:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471551488 00000100:00100000:2.0:1789776661.308827:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789776661.308836:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bae17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+19:15748:x1876716471551488:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789776661.309098:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bae17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+19:15748:x1876716471551488:12345-0@lo:502:mount.lustre.0 Request processed in 262us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776661.309112:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789776661.309121:0:15748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7bf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15748:1876716471551488:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789776661.309204:0:15748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1789776661.309246:0:15748:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1789776661.310777:0:15758:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789776661.310794:0:15758:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9c8692063370) 00000020:00000080:0.0:1789776661.310817:0:15758:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1789776661.310925:0:15758:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c86beb07800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789776661.310930:0:15758:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c86beb07800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789776661.310932:0:15758:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c86beb07800 3 00010000:00080000:0.0:1789776661.310962:0:15758:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c85832ea000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.106@tcp at head 00010000:00010000:0.0:1789776661.314512:0:15758:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1789776661.315419:0:15758:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1789776661.315462:0:15758:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789776661.315476:0:15758:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x26940258de8f0358 00000100:00080000:0.0:1789776661.315485:0:15758:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789776661.315491:0:15758:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c85832ea000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1789776661.315527:0:15758:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c86b9e79c00 x1876716471551616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789776661.315560:0:15758:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789776661.315778:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3272:1876716471551616:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789776661.315851:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776661.315997:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471551616 00000100:00100000:0.0:1789776661.316006:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471551616 00000100:00100000:0.0:1789776661.316047:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789776661.316054:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3272:x1876716471551616:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789776661.316077:0:14347:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 414 last 0 00000020:00000080:0.0:1789776661.316116:0:14347:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x26940258de8f035f 00000004:00100000:0.0:1789776661.316130:0:14347:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789776661.316161:0:14347:0:(import.c:65:import_set_state_nolock()) ffff9c85832ef800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789776661.317016:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3272:x1876716471551616:12345-0@lo:38:llog_process_th.0 Request processed in 958us (1161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776661.317027:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789776661.317105:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c86b9e79c00 x1876716471551616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789776671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776661.317117:0:3272:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789776661.317125:0:3272:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1789776661.317139:0:3272:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789776661.317143:0:3272:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789776661.317146:0:3272:0:(import.c:65:import_set_state_nolock()) ffff9c85832ea000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789776661.317153:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3272:1876716471551616:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1789776661.317741:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789776661.317746:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789776661.317749:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c86b39ca800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789776661.317754:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 412 00000100:00080000:0.0:1789776661.317759:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789776661.317764:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c86b39ca800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1789776661.317781:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c86b9e78700 x1876716471551872/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789776661.317969:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471551744:0@lo:400:kworker.0 00000100:00100000:1.0:1789776661.318020:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776661.318051:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789776661.318056:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3275:1876716471552000:0@lo:400:kworker.0 00000100:00100000:1.0:1789776661.318080:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776661.318119:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471552000 00000100:00100000:1.0:1789776661.318124:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471552000 00000100:00100000:1.0:1789776661.318161:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789776661.318170:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1876716471552000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776661.318249:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1876716471552000:12345-0@lo:400:kworker.0 Request processed in 80us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776661.318256:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1789776661.318285:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c86b9e78e00 x1876716471552000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776661.318296:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3275:1876716471552000:0@lo:400:kworker.0 00000100:00100000:1.0:1789776661.318313:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3272:1876716471551872:0@lo:8:kworker.0 00000100:00100000:1.0:1789776661.318336:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776661.318360:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471551744 00000100:00100000:1.0:1789776661.318363:0:15031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471551744 00000100:00100000:1.0:1789776661.318397:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471551872 00000100:00100000:1.0:1789776661.318399:0:15031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471551872 00000100:00100000:1.0:1789776661.318412:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789776661.318427:0:15031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3275:x1876716471551744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776661.318458:0:15031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3275:x1876716471551744:12345-0@lo:400:kworker.0 Request processed in 33us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776661.318464:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789776661.318475:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789776661.318479:0:15031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3272:x1876716471551872:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1789776661.318513:0:15031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3272:x1876716471551872:12345-0@lo:8:kworker.0 Request processed in 33us (176us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789776661.318519:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1789776661.318531:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789776661.318547:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471551744:0@lo:400:kworker.0 00000100:00100000:1.0:1789776661.318568:0:3272:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789776661.318573:0:3272:0:(import.c:65:import_set_state_nolock()) ffff9c86b39ca800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789776661.318576:0:3272:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789776661.318579:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3272:1876716471551872:0@lo:8:kworker.0 00000040:00080000:0.0:1789776661.319081:0:15758:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:3.0:1789776661.319518:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3273:1876716471552128:0@lo:400:kworker.0 00000100:00100000:3.0:1789776661.319555:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1789776661.319681:0:15748:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1789776661.319709:0:15748:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789776661.319721:0:15748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8686774a00/0x26940258de8f0343 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f034a expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776661.319731:0:15748:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c8686774a00/0x26940258de8f0343 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f034a expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789776661.319773:0:15748:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789776661.319775:0:15748:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789776661.319777:0:15748:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789776661.319778:0:15748:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789776661.319779:0:15748:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789776661.319783:0:15748:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789776661.319784:0:15748:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789776661.319786:0:15748:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789776661.319787:0:15748:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789776661.319790:0:15748:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1789776661.319792:0:15748:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789776661.319794:0:15748:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789776661.319795:0:15748:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789776661.319796:0:15748:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789776661.319797:0:15748:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789776661.319798:0:15748:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789776661.319799:0:15748:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789776661.319800:0:15748:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789776661.319801:0:15748:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789776661.319818:0:15748:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789776661.319829:0:15748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15748:1876716471552256:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789776661.319979:0:15748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776661.320002:0:15748:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86906b4240 going to sleep for 11 seconds 00000100:00100000:2.0:1789776661.320326:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471552128 00000100:00100000:2.0:1789776661.320332:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471552128 00000100:00100000:2.0:1789776661.320371:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789776661.320379:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1876716471552128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776661.320422:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1876716471552128:12345-0@lo:400:kworker.0 Request processed in 44us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776661.320428:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1789776661.320461:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c86b9e79180 x1876716471552128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789776661.320473:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3273:1876716471552128:0@lo:400:kworker.0 00000100:00100000:0.0:1789776661.320701:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471552256 00000100:00100000:0.0:1789776661.320705:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471552256 00000100:00100000:0.0:1789776661.320729:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789776661.320735:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+19:15748:x1876716471552256:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789776661.320753:0:14342:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789776661.320766:0:14342:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:1.0:1789776661.321048:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:0.0:1789776661.363451:0:14342:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789776661.363472:0:14342:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1789776661.363571:0:14363:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789776661.363577:0:14363:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789776661.363609:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c8681678600/0x26940258de8f0366 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776661.363644:0:14363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c8686775800/0x26940258de8f0240 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8f0239 expref: 19 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776661.363650:0:14363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c8681678600/0x26940258de8f0366 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776661.363690:0:14363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c8686775800/0x26940258de8f0240 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26940258de8f0239 expref: 19 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776661.363705:0:14363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c8686775800/0x26940258de8f0240 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26940258de8f0239 expref: 19 pid: 14339 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776661.363720:0:14363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7fb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14363:1876716471552384:0@lo:104: 00000100:00100000:3.0:1789776661.363791:0:14363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776661.364061:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471552384 00000100:00100000:0.0:1789776661.364071:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471552384 00000100:00100000:0.0:1789776661.364120:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789776661.364129:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+3:14363:x1876716471552384:12345-0@lo:104: 00010000:00010000:0.0:1789776661.364150:0:14331:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c86bf5cb600/0x26940258de8f0239 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8f0240 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776661.364212:0:14331:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789776661.364238:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+3:14363:x1876716471552384:12345-0@lo:104: Request processed in 110us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776661.364245:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1789776661.364271:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789776661.364276:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c86bf5cb600/0x26940258de8f0239 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8f0240 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776661.364284:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86bf5cb600 already unused, calling callback (ffffffffc1da0c20) 10000000:00010000:0.0:1789776661.364288:0:14336:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c86bf5cb600/0x26940258de8f0239 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26940258de8f0240 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776661.364297:0:14336:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c86bf5cb600/0x26940258de8f0239 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26940258de8f0240 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789776661.364305:0:14336:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c86bf5cb600/0x26940258de8f0239 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26940258de8f0240 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789776661.364311:0:14336:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789776661.364344:0:14336:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c86bf5cb600/0x26940258de8f0239 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8f0240 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776661.364350:0:14336:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789776661.364371:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c86bf5cb600/0x26940258de8f0239 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8f0240 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776661.364377:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c86bf5cb600/0x26940258de8f0239 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8f0240 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776661.364406:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776661.364408:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776661.364410:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776661.364425:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789776661.364437:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:3273:1876716471552512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789776661.364467:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776661.364500:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471552512 00000100:00100000:0.0:1789776661.364504:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471552512 00010000:00010000:0.0:1789776661.364520:0:14334:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c8686775800/0x26940258de8f0240 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8f0239 expref: 20 pid: 14339 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776661.364540:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789776661.364546:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+20:3273:x1876716471552512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789776661.364556:0:14334:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776661.364562:0:14334:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c8686775800/0x26940258de8f0240 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8f0239 expref: 20 pid: 14339 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776661.364572:0:14334:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c8686775800/0x26940258de8f0240 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26940258de8f0239 expref: 20 pid: 14339 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776661.364601:0:14334:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c8681678600/0x26940258de8f0366 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776661.364609:0:14334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c8681678600/0x26940258de8f0366 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789776661.364622:0:14334:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004722700s 00010000:00010000:0.0:1789776661.364627:0:14334:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c8681678600/0x26940258de8f0366 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776661.364640:0:14334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c8681678600/0x26940258de8f0366 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776661.364647:0:14334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c8681678600/0x26940258de8f0366 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776661.364652:0:14334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c8681678600/0x26940258de8f0366 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776661.364658:0:14334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681678600 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:0.0:1789776661.364661:0:14334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c8681678600/0x26940258de8f0366 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776661.364668:0:14334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c8681678600/0x26940258de8f0366 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776661.364678:0:14334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c8681678600/0x26940258de8f0366 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776661.364688:0:14334:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776661.364719:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+20:3273:x1876716471552512:12345-0@lo:103:ldlm_bl.0 Request processed in 171us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776661.364726:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789776661.364758:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:3273:1876716471552512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789776661.364996:0:14363:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8682e953c0 going to sleep for 11 seconds 00010000:00010000:3.0:1789776661.365013:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c8686775800/0x26940258de8f0240 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26940258de8f0239 expref: 19 pid: 14339 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776661.365024:0:14363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7fb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14363:1876716471552384:0@lo:104: 00010000:00010000:3.0:1789776661.365037:0:14363:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c8681678600/0x26940258de8f0366 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776661.365046:0:14363:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c8681678600/0x26940258de8f0366 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776661.365052:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c8681678600/0x26940258de8f0366 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776661.365059:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c8681678600/0x26940258de8f0366 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776661.374434:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+18:15748:x1876716471552256:12345-0@lo:253:mount.lustre.0 Request processed in 53688us (54443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776661.374448:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789776661.374579:0:15748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:15748:1876716471552256:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789776661.374661:0:15748:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789776661.374666:0:15748:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789776661.374668:0:15748:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789776661.374669:0:15748:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789776661.374670:0:15748:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789776661.374671:0:15748:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789776661.374673:0:15748:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789776661.374674:0:15748:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789776661.374676:0:15748:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789776661.374678:0:15748:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789776661.374693:0:15748:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789776661.382946:0:15748:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789776661.383130:0:15748:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789776661.383403:0:15748:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789776661.383566:0:15748:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789776661.383827:0:15748:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789776661.384181:0:15748:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789776661.385576:0:15748:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1789776661.435260:0:15748:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789776661.435273:0:15748:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789776661.435307:0:15748:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789776661.435370:0:15748:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.106@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789776661.435389:0:15748:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789776661.435419:0:15748:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1789776662.228661:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789776662.616922:0:14344:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789776662.616929:0:14344:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c8688152000 from 8 10000000:01000000:2.0:1789776662.616933:0:14344:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789776662.616981:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8686775c00/0x26940258de8f036d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776662.616990:0:14344:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c8686775c00/0x26940258de8f036d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776662.616998:0:14344:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c8686775c00/0x26940258de8f036d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776662.617018:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14344:1876716471552640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789776662.617077:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776662.617160:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86b9e51240 going to sleep for 11 seconds 00000100:00100000:3.0:1789776662.619291:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471552640 00000100:00100000:3.0:1789776662.619308:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471552640 00000100:00100000:3.0:1789776662.619504:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789776662.619517:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+18:14344:x1876716471552640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789776662.619534:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776662.619553:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c8681678600/0x26940258de8f0374 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8f036d expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776662.619581:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c8681678600/0x26940258de8f0374 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8f036d expref: 19 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776662.619592:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c8681678600/0x26940258de8f0374 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8f036d expref: 19 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776662.619601:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8681678600, rc 0) 00000100:00100000:3.0:1789776662.619677:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+19:14344:x1876716471552640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (2598us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776662.624195:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789776662.624310:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14344:1876716471552640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789776662.624338:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c8686775c00/0x26940258de8f036d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f0374 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776662.624350:0:14344:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c8686775c00/0x26940258de8f036d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8f0374 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776662.624439:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14344:1876716471552768:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789776662.624515:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776662.624555:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bc8f6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789776662.624677:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471552768 00000100:00100000:1.0:1789776662.624683:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471552768 00000100:00100000:1.0:1789776662.624724:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789776662.624733:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+19:14344:x1876716471552768:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789776662.624753:0:14342:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789776662.624770:0:14342:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789776662.624773:0:14342:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1789776662.624876:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+19:14344:x1876716471552768:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 144us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776662.624883:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789776662.625039:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14344:1876716471552768:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789776662.625096:0:14344:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789776662.625104:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8686775c00/0x26940258de8f036d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f0374 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776662.625112:0:14344:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c8686775c00/0x26940258de8f036d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f0374 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776663.261816:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789776663.596681:0:6684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1789776663.596756:0:6684:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1789776664.277328:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776664.468491:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789776664.468516:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471552896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789776664.468598:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776664.471725:0:15034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471552896 00000100:00100000:0.0:1789776664.471743:0:15034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471552896 00000100:00100000:0.0:1789776664.471830:0:15034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789776664.471843:0:15034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471552896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789776664.471885:0:15034:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789776664.471988:0:15034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471552896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (3389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776664.472006:0:15034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789776664.472280:0:3276:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1789776664.472306:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471552896:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789776664.472496:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789776665.300432:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776666.325788:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776666.519403:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:3276:1876716471553024:0@lo:400:kworker.0 00000100:00100000:3.0:1789776666.519483:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776666.519568:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471553024 00000100:00100000:0.0:1789776666.519576:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471553024 00000100:00100000:0.0:1789776666.519623:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789776666.519632:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+19:3276:x1876716471553024:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789776666.521998:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789776666.522004:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789776666.522008:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c86b39ca800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789776666.522020:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c86b39ca800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1789776666.522046:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c86bf7bc000 x1876716471553280/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789776666.524657:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+19:3276:x1876716471553024:12345-0@lo:400:kworker.0 Request processed in 5017us (5172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776666.524672:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789776666.524813:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:3276:1876716471553024:0@lo:400:kworker.0 00000100:00100000:3.0:1789776666.524837:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789776666.524848:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3276:1876716471553536:0@lo:400:kworker.0 00000100:00100000:3.0:1789776666.524905:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776666.525179:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789776666.525189:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3275:1876716471553664:0@lo:400:kworker.0 00000100:00100000:1.0:1789776666.525334:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776666.525672:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471553152:0@lo:400:kworker.0 00000100:00100000:1.0:1789776666.525700:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776666.525720:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789776666.525725:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3273:1876716471553408:0@lo:400:kworker.0 00000100:00100000:1.0:1789776666.525746:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776666.525805:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471553536 00000100:00100000:0.0:1789776666.525813:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471553536 00000100:00100000:0.0:1789776666.525865:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471553664 00000100:00100000:0.0:1789776666.525869:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471553664 00000100:00100000:0.0:1789776666.525891:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789776666.525900:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876716471553536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776666.525953:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1876716471553536:12345-0@lo:400:kworker.0 Request processed in 55us (1048us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776666.525960:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789776666.525975:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789776666.525982:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1876716471553664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776666.526014:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1876716471553664:12345-0@lo:400:kworker.0 Request processed in 33us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776666.526034:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789776666.526129:0:3272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3272:1876716471553280:0@lo:8:kworker.0 00000100:00100000:1.0:1789776666.526184:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776666.526269:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471553152 00000100:00100000:1.0:1789776666.526273:0:15031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471553152 00000100:00100000:1.0:1789776666.526301:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471553280 00000100:00100000:1.0:1789776666.526304:0:15031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471553280 00000100:00100000:1.0:1789776666.526318:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789776666.526324:0:15031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471553152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776666.526355:0:15031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471553152:12345-0@lo:400:kworker.0 Request processed in 31us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776666.526360:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789776666.526371:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789776666.526381:0:15031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3272:x1876716471553280:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789776666.526402:0:15031:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 419 last 0 00000020:00000080:1.0:1789776666.526427:0:15031:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x26940258de8f037b 00002000:00100000:1.0:1789776666.526440:0:15031:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9c86beb00800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396f ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789776666.526444:0:15031:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1789776666.526446:0:15031:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1789776666.526570:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471553408 00000100:00100000:3.0:1789776666.526574:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471553408 00000100:00100000:3.0:1789776666.526634:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789776666.526641:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1876716471553408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776666.526674:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3273:x1876716471553408:12345-0@lo:400:kworker.0 Request processed in 35us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776666.526681:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1789776666.526714:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bf7bfb80 x1876716471553536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776666.526727:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3276:1876716471553536:0@lo:400:kworker.0 00002000:00080000:1.0:1789776666.527036:0:15031:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789776666.527056:0:15031:0:(import.c:65:import_set_state_nolock()) ffff9c86beb06000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1789776666.527299:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789776666.527304:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789776666.528575:0:15031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3272:x1876716471553280:12345-0@lo:8:kworker.0 Request processed in 2186us (2385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776666.528587:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789776666.528653:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bf7bce00 x1876716471553408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776666.528668:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3273:1876716471553408:0@lo:400:kworker.0 00000100:00100000:1.0:1789776666.528682:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471553152:0@lo:400:kworker.0 00010000:00080000:3.0:1789776666.529718:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bf7bc380 x1876716471553664/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789776682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789776666.529733:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3275:1876716471553664:0@lo:400:kworker.0 00010000:00080000:2.0:1789776666.534588:0:3272:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86bf7bc000 x1876716471553280/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789776691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789776666.534612:0:3272:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789776666.534621:0:3272:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789776666.534626:0:3272:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789776666.534630:0:3272:0:(import.c:65:import_set_state_nolock()) ffff9c86b39ca800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789776666.534647:0:3272:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789776666.534654:0:3272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3272:1876716471553280:0@lo:8:kworker.0 00000004:00080000:2.0:1789776666.534730:0:14372:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:2.0:1789776666.534751:0:14372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6eb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14372:1876716471553920:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789776666.536578:0:14371:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789776666.536986:0:14371:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 419316768312ns, next at 0ns, rc = 0 00000100:00100000:0.0:1789776666.537026:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471553792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789776666.537600:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776666.538617:0:15034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471553792 00000100:00100000:1.0:1789776666.538626:0:15034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471553792 00000100:00100000:1.0:1789776666.538697:0:15034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789776666.538708:0:15034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3273:x1876716471553792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789776666.538744:0:15034:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789776666.538816:0:15034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3273:x1876716471553792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776666.538824:0:15034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1789776666.538867:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789776666.538870:0:3273:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c86ba6eaa00 x1876716471553792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789776682 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789776666.538907:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471553792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789776666.542025:0:14372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776666.542073:0:14372:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bb53f180 going to sleep for 11 seconds 00000100:00100000:2.0:1789776666.542105:0:15032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471553920 00000100:00100000:2.0:1789776666.542113:0:15032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471553920 00000100:00100000:2.0:1789776666.542178:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789776666.542191:0:15032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14372:x1876716471553920:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1789776666.555184:0:15032:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1789776666.555195:0:15032:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1789776666.555199:0:15032:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:2.0:1789776666.570934:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789776666.570947:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6fc951c/0x26940258de8f0382 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.570965:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=419s v=(0 0) 00010000:00010000:2.0:1789776666.570970:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776666.570984:0:15032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6fc951c/0x26940258de8f0382 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.571002:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6fc951c/0x26940258de8f0382 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.571014:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6fc951c/0x26940258de8f0382 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.571022:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6fc951c/0x26940258de8f0382 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.571051:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789776666.571546:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789776666.571551:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000403f2cc9/0x26940258de8f0389 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.571561:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=419s v=(0 0) 00010000:00010000:2.0:1789776666.571565:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776666.571569:0:15032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000403f2cc9/0x26940258de8f0389 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.571579:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000403f2cc9/0x26940258de8f0389 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.571588:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000403f2cc9/0x26940258de8f0389 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.571606:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000403f2cc9/0x26940258de8f0389 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.571621:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789776666.571991:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789776666.571997:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef25f3f2/0x26940258de8f0390 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.572006:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=419s v=(0 0) 00010000:00010000:2.0:1789776666.572009:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776666.572013:0:15032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef25f3f2/0x26940258de8f0390 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.572022:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef25f3f2/0x26940258de8f0390 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.572029:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef25f3f2/0x26940258de8f0390 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.572036:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef25f3f2/0x26940258de8f0390 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.572044:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1789776666.573109:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789776666.573120:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6fc951c/0x26940258de8f0382 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776666.573131:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8686775800 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:3.0:1789776666.573135:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6fc951c/0x26940258de8f0382 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776666.573145:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6fc951c/0x26940258de8f0382 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776666.573177:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6fc951c/0x26940258de8f0382 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776666.573185:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6fc951c/0x26940258de8f0382 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776666.573209:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789776666.573212:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000403f2cc9/0x26940258de8f0389 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776666.573251:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8686775400 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:3.0:1789776666.573254:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000403f2cc9/0x26940258de8f0389 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776666.573263:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000403f2cc9/0x26940258de8f0389 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776666.573274:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000403f2cc9/0x26940258de8f0389 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776666.573280:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000403f2cc9/0x26940258de8f0389 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776666.573294:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789776666.573298:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef25f3f2/0x26940258de8f0390 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776666.573305:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8686774200 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:3.0:1789776666.573308:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef25f3f2/0x26940258de8f0390 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776666.573316:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef25f3f2/0x26940258de8f0390 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776666.573326:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef25f3f2/0x26940258de8f0390 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776666.573339:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef25f3f2/0x26940258de8f0390 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776666.573353:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776666.573355:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776666.573357:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776666.581268:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789776666.581738:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789776666.581754:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d27833f/0x26940258de8f0397 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.581772:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=419s v=(0 0) 00010000:00010000:2.0:1789776666.581777:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776666.581783:0:15032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d27833f/0x26940258de8f0397 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.581799:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d27833f/0x26940258de8f0397 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.581810:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d27833f/0x26940258de8f0397 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.581818:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d27833f/0x26940258de8f0397 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.581843:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789776666.582302:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789776666.582309:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8d03d0b/0x26940258de8f039e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.582318:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=419s v=(0 0) 00010000:00010000:2.0:1789776666.582321:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776666.582325:0:15032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8d03d0b/0x26940258de8f039e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.582334:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8d03d0b/0x26940258de8f039e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.582349:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8d03d0b/0x26940258de8f039e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.582355:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8d03d0b/0x26940258de8f039e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.582371:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789776666.582381:0:14335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789776666.582387:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d27833f/0x26940258de8f0397 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.582395:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8686775200 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:2.0:1789776666.582400:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d27833f/0x26940258de8f0397 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.582410:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d27833f/0x26940258de8f0397 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.582429:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d27833f/0x26940258de8f0397 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776666.582430:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776666.582442:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d27833f/0x26940258de8f0397 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.582461:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776666.582469:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776666.582471:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789776666.582878:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789776666.582885:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cda8ee41/0x26940258de8f03a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.582894:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=419s v=(0 0) 00010000:00010000:2.0:1789776666.582897:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776666.582901:0:15032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cda8ee41/0x26940258de8f03a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.582910:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cda8ee41/0x26940258de8f03a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.582917:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cda8ee41/0x26940258de8f03a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.582924:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cda8ee41/0x26940258de8f03a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.582937:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789776666.582945:0:14335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776666.582948:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cda8ee41/0x26940258de8f03a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.582955:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc7c00 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:2.0:1789776666.582959:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cda8ee41/0x26940258de8f03a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.582978:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cda8ee41/0x26940258de8f03a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.582989:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cda8ee41/0x26940258de8f03a5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.582997:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cda8ee41/0x26940258de8f03a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.583013:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776666.583015:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776666.583016:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789776666.583478:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789776666.583483:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008606230/0x26940258de8f03ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.583492:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=419s v=(0 0) 00010000:00010000:2.0:1789776666.583496:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776666.583500:0:15032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008606230/0x26940258de8f03ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.583509:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008606230/0x26940258de8f03ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.583517:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008606230/0x26940258de8f03ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.583530:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008606230/0x26940258de8f03ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.583544:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789776666.583552:0:14335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776666.583556:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008606230/0x26940258de8f03ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.583562:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc6000 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:2.0:1789776666.583565:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008606230/0x26940258de8f03ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.583573:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008606230/0x26940258de8f03ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.583583:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008606230/0x26940258de8f03ac lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.583589:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008606230/0x26940258de8f03ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.583602:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776666.583604:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776666.583605:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789776666.583974:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789776666.583986:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000108710d5/0x26940258de8f03b3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.583996:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=419s v=(0 0) 00010000:00010000:2.0:1789776666.583999:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776666.584004:0:15032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000108710d5/0x26940258de8f03b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.584013:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000108710d5/0x26940258de8f03b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.584021:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000108710d5/0x26940258de8f03b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.584028:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000108710d5/0x26940258de8f03b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.584042:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789776666.584049:0:14335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776666.584053:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000108710d5/0x26940258de8f03b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.584059:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc7800 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:2.0:1789776666.584062:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000108710d5/0x26940258de8f03b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.584070:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000108710d5/0x26940258de8f03b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.584085:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000108710d5/0x26940258de8f03b3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.584093:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000108710d5/0x26940258de8f03b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.584107:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776666.584109:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776666.584111:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776666.587766:0:16063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776666.587784:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8d03d0b/0x26940258de8f039e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776666.587799:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8686774600 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:1.0:1789776666.587804:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8d03d0b/0x26940258de8f039e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776666.587815:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8d03d0b/0x26940258de8f039e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776666.587843:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8d03d0b/0x26940258de8f039e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776666.587851:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8d03d0b/0x26940258de8f039e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776666.587879:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776666.587881:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776666.587883:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776666.587889:0:16063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776666.587891:0:16063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789776666.591039:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789776666.591053:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f41e7d19/0x26940258de8f03ba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.591071:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=419s v=(0 0) 00010000:00010000:2.0:1789776666.591076:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776666.591083:0:15032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f41e7d19/0x26940258de8f03ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.591103:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f41e7d19/0x26940258de8f03ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.591114:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f41e7d19/0x26940258de8f03ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.591126:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f41e7d19/0x26940258de8f03ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.591163:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789776666.591177:0:14335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776666.591183:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f41e7d19/0x26940258de8f03ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.591191:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc6200 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:2.0:1789776666.591195:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f41e7d19/0x26940258de8f03ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.591204:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f41e7d19/0x26940258de8f03ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.591241:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f41e7d19/0x26940258de8f03ba lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.591248:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f41e7d19/0x26940258de8f03ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.591268:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776666.591342:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776666.591345:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789776666.592957:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789776666.592968:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000003c547c/0x26940258de8f03c1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.592984:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=419s v=(0 0) 00010000:00010000:2.0:1789776666.592996:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776666.593003:0:15032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000003c547c/0x26940258de8f03c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.593017:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000003c547c/0x26940258de8f03c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.593027:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000003c547c/0x26940258de8f03c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.593035:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000003c547c/0x26940258de8f03c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.593060:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789776666.593077:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776666.593083:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000003c547c/0x26940258de8f03c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.593091:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc6e00 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:2.0:1789776666.593096:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000003c547c/0x26940258de8f03c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.593105:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000003c547c/0x26940258de8f03c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.593121:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000003c547c/0x26940258de8f03c1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.593140:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000003c547c/0x26940258de8f03c1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.593172:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776666.593174:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776666.593176:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789776666.594687:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789776666.594696:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be0cbfdf/0x26940258de8f03c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.594710:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=419s v=(0 0) 00010000:00010000:2.0:1789776666.594715:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776666.594721:0:15032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be0cbfdf/0x26940258de8f03c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.594733:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be0cbfdf/0x26940258de8f03c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.594743:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be0cbfdf/0x26940258de8f03c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.594749:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be0cbfdf/0x26940258de8f03c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.594771:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789776666.595202:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789776666.595237:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0ab960b/0x26940258de8f03cf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.595247:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=419s v=(0 0) 00010000:00010000:2.0:1789776666.595250:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776666.595255:0:15032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0ab960b/0x26940258de8f03cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.595265:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0ab960b/0x26940258de8f03cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.595273:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0ab960b/0x26940258de8f03cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.595280:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0ab960b/0x26940258de8f03cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.595294:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789776666.595308:0:14335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789776666.595314:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be0cbfdf/0x26940258de8f03c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.595322:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc7e00 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:2.0:1789776666.595326:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be0cbfdf/0x26940258de8f03c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.595335:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be0cbfdf/0x26940258de8f03c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.595357:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be0cbfdf/0x26940258de8f03c8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.595364:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be0cbfdf/0x26940258de8f03c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.595384:0:14335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776666.595387:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0ab960b/0x26940258de8f03cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.595394:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc7a00 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:2.0:1789776666.595398:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0ab960b/0x26940258de8f03cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.595405:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0ab960b/0x26940258de8f03cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.595415:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0ab960b/0x26940258de8f03cf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.595421:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0ab960b/0x26940258de8f03cf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.595433:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776666.595435:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776666.595442:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789776666.595860:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789776666.595866:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d16c1d1/0x26940258de8f03d6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.595875:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=419s v=(0 0) 00010000:00010000:2.0:1789776666.595878:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776666.595881:0:15032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d16c1d1/0x26940258de8f03d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.595889:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d16c1d1/0x26940258de8f03d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.595896:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d16c1d1/0x26940258de8f03d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.595903:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d16c1d1/0x26940258de8f03d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.595916:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789776666.595923:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776666.595928:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d16c1d1/0x26940258de8f03d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.595934:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc6600 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:2.0:1789776666.595936:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d16c1d1/0x26940258de8f03d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.595955:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d16c1d1/0x26940258de8f03d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.595966:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d16c1d1/0x26940258de8f03d6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.595973:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d16c1d1/0x26940258de8f03d6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.595988:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776666.595989:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776666.595991:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789776666.599345:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789776666.599363:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003339ae30/0x26940258de8f03dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.599382:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=419s v=(0 0) 00010000:00010000:2.0:1789776666.599387:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776666.599394:0:15032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003339ae30/0x26940258de8f03dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.599409:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003339ae30/0x26940258de8f03dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.599421:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003339ae30/0x26940258de8f03dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.599435:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003339ae30/0x26940258de8f03dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.599459:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789776666.599477:0:14335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776666.599495:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003339ae30/0x26940258de8f03dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.599504:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc6800 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:2.0:1789776666.599509:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003339ae30/0x26940258de8f03dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.599518:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003339ae30/0x26940258de8f03dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.599534:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003339ae30/0x26940258de8f03dd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.599542:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003339ae30/0x26940258de8f03dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.599565:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776666.599567:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776666.599569:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776666.599579:0:16063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789776666.602059:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789776666.602071:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000099c46fd/0x26940258de8f03e4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.602088:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=419s v=(0 0) 00010000:00010000:2.0:1789776666.602092:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776666.602098:0:15032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000099c46fd/0x26940258de8f03e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.602113:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000099c46fd/0x26940258de8f03e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.602123:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000099c46fd/0x26940258de8f03e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.602131:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000099c46fd/0x26940258de8f03e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.602160:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789776666.602171:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776666.602177:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000099c46fd/0x26940258de8f03e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.602185:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc6400 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:2.0:1789776666.602190:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000099c46fd/0x26940258de8f03e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.602211:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000099c46fd/0x26940258de8f03e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.602248:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000099c46fd/0x26940258de8f03e4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.602256:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000099c46fd/0x26940258de8f03e4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.602289:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776666.602292:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776666.602294:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789776666.602774:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789776666.602780:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008504bfdd/0x26940258de8f03eb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.602789:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=419s v=(0 0) 00010000:00010000:2.0:1789776666.602793:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776666.602797:0:15032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008504bfdd/0x26940258de8f03eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.602805:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008504bfdd/0x26940258de8f03eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.602812:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008504bfdd/0x26940258de8f03eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.602825:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008504bfdd/0x26940258de8f03eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.602840:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789776666.602850:0:14335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776666.602856:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008504bfdd/0x26940258de8f03eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.602864:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc7600 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:2.0:1789776666.602868:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008504bfdd/0x26940258de8f03eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.602876:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008504bfdd/0x26940258de8f03eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.602889:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008504bfdd/0x26940258de8f03eb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.602896:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008504bfdd/0x26940258de8f03eb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.602912:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776666.602914:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776666.602916:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789776666.603408:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789776666.603423:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a043c85a/0x26940258de8f03f2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.603432:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=419s v=(0 0) 00010000:00010000:2.0:1789776666.603436:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776666.603440:0:15032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a043c85a/0x26940258de8f03f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.603451:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a043c85a/0x26940258de8f03f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.603459:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a043c85a/0x26940258de8f03f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.603467:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a043c85a/0x26940258de8f03f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.603483:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789776666.603858:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789776666.603863:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d96be04d/0x26940258de8f03f9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.603872:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=419s v=(0 0) 00010000:00010000:2.0:1789776666.603875:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776666.603879:0:15032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d96be04d/0x26940258de8f03f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.603888:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d96be04d/0x26940258de8f03f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.603901:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d96be04d/0x26940258de8f03f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.603909:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d96be04d/0x26940258de8f03f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.603922:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789776666.603931:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789776666.603936:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a043c85a/0x26940258de8f03f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.603944:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc7200 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:2.0:1789776666.603948:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a043c85a/0x26940258de8f03f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.603956:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a043c85a/0x26940258de8f03f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.603969:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a043c85a/0x26940258de8f03f2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.603976:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a043c85a/0x26940258de8f03f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.603995:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776666.604003:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d96be04d/0x26940258de8f03f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.604011:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc7400 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:2.0:1789776666.604014:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d96be04d/0x26940258de8f03f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.609165:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d96be04d/0x26940258de8f03f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.609194:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d96be04d/0x26940258de8f03f9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.609203:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d96be04d/0x26940258de8f03f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.609266:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776666.609268:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776666.609271:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776666.609276:0:16063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789776666.609940:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789776666.609950:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014ae1994/0x26940258de8f0400 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.609964:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=419s v=(0 0) 00010000:00010000:2.0:1789776666.609969:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776666.609976:0:15032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014ae1994/0x26940258de8f0400 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.610001:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014ae1994/0x26940258de8f0400 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.610010:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014ae1994/0x26940258de8f0400 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.610017:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014ae1994/0x26940258de8f0400 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.610039:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789776666.612271:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789776666.612283:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000108710d5/0x26940258de8f0407 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.612301:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=419s v=(0 0) 00010000:00010000:2.0:1789776666.612305:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776666.612312:0:15032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000108710d5/0x26940258de8f0407 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.612327:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000108710d5/0x26940258de8f0407 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.612336:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000108710d5/0x26940258de8f0407 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.612355:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000108710d5/0x26940258de8f0407 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.612557:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789776666.612574:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789776666.612581:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014ae1994/0x26940258de8f0400 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.612589:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc6a00 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:2.0:1789776666.612593:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014ae1994/0x26940258de8f0400 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.612603:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014ae1994/0x26940258de8f0400 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.612621:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014ae1994/0x26940258de8f0400 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.612627:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014ae1994/0x26940258de8f0400 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.612646:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776666.612649:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000108710d5/0x26940258de8f0407 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.612666:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc7800 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:2.0:1789776666.612670:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000108710d5/0x26940258de8f0407 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.612676:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000108710d5/0x26940258de8f0407 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.612686:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000108710d5/0x26940258de8f0407 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.613060:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000108710d5/0x26940258de8f0407 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.613079:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776666.613081:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776666.613083:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776666.613327:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789776666.616970:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789776666.616985:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000245efdd7/0x26940258de8f040e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776666.617003:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1789776666.617008:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789776666.617680:0:15032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000245efdd7/0x26940258de8f040e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776666.617702:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000245efdd7/0x26940258de8f040e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776666.617714:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000245efdd7/0x26940258de8f040e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776666.617723:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000245efdd7/0x26940258de8f040e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.617816:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789776666.617830:0:16063:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776666.617838:0:16063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000245efdd7/0x26940258de8f040e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.617847:0:16063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681678c00 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:2.0:1789776666.617852:0:16063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000245efdd7/0x26940258de8f040e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.617873:0:16063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000245efdd7/0x26940258de8f040e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.617890:0:16063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000245efdd7/0x26940258de8f040e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.617899:0:16063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000245efdd7/0x26940258de8f040e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.617917:0:16063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776666.617919:0:16063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776666.617921:0:16063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789776666.619632:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:2.0:1789776666.619845:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789776666.619855:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d96be04d/0x26940258de8f0415 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.619873:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=419s v=(0 0) 00010000:00010000:2.0:1789776666.619878:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776666.619884:0:15032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d96be04d/0x26940258de8f0415 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.619896:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d96be04d/0x26940258de8f0415 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.619904:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d96be04d/0x26940258de8f0415 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.619922:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d96be04d/0x26940258de8f0415 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.619940:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789776666.619955:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776666.619961:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d96be04d/0x26940258de8f0415 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.619970:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc7400 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:2.0:1789776666.619974:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d96be04d/0x26940258de8f0415 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.619983:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d96be04d/0x26940258de8f0415 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.620000:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d96be04d/0x26940258de8f0415 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.620008:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d96be04d/0x26940258de8f0415 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.620026:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776666.620028:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776666.620030:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789776666.631074:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789776666.631089:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcaa9503/0x26940258de8f041c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776666.631109:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=419s v=(0 0) 00010000:00010000:0.0:1789776666.631114:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789776666.631120:0:15032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcaa9503/0x26940258de8f041c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776666.631137:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcaa9503/0x26940258de8f041c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776666.631156:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcaa9503/0x26940258de8f041c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776666.631165:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fcaa9503/0x26940258de8f041c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776666.631197:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789776666.632760:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789776666.632777:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088632243/0x26940258de8f0423 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776666.632793:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=419s v=(0 0) 00010000:00010000:1.0:1789776666.632919:0:14335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776666.632946:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fcaa9503/0x26940258de8f041c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776666.632956:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b09e00 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:1.0:1789776666.632961:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcaa9503/0x26940258de8f041c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776666.632972:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcaa9503/0x26940258de8f041c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776666.632992:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fcaa9503/0x26940258de8f041c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776666.632999:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcaa9503/0x26940258de8f041c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776666.633017:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776666.633019:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776666.633021:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776666.633644:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789776666.633656:0:15032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088632243/0x26940258de8f0423 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776666.633671:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088632243/0x26940258de8f0423 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776666.633681:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088632243/0x26940258de8f0423 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776666.633689:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088632243/0x26940258de8f0423 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776666.633716:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789776666.633742:0:16063:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789776666.633755:0:16063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088632243/0x26940258de8f0423 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776666.633764:0:16063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b08a00 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:3.0:1789776666.633768:0:16063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088632243/0x26940258de8f0423 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776666.633777:0:16063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088632243/0x26940258de8f0423 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776666.633791:0:16063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088632243/0x26940258de8f0423 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776666.633798:0:16063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088632243/0x26940258de8f0423 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776666.633814:0:16063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776666.633816:0:16063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776666.633818:0:16063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789776666.635712:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789776666.635724:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095df49cb/0x26940258de8f042a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776666.635740:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=419s v=(0 0) 00010000:00010000:0.0:1789776666.635745:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789776666.635752:0:15032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095df49cb/0x26940258de8f042a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776666.635764:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095df49cb/0x26940258de8f042a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776666.635792:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095df49cb/0x26940258de8f042a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776666.636501:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095df49cb/0x26940258de8f042a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776666.636855:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789776666.637738:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776666.637748:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095df49cb/0x26940258de8f042a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.637767:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b09a00 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:2.0:1789776666.637772:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095df49cb/0x26940258de8f042a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.637784:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095df49cb/0x26940258de8f042a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.637805:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095df49cb/0x26940258de8f042a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.637813:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095df49cb/0x26940258de8f042a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.637835:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776666.637836:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776666.637838:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789776666.641159:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789776666.641175:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ca9f140/0x26940258de8f0431 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776666.641194:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=419s v=(0 0) 00010000:00010000:0.0:1789776666.641199:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789776666.641205:0:15032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ca9f140/0x26940258de8f0431 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776666.641235:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ca9f140/0x26940258de8f0431 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776666.641247:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ca9f140/0x26940258de8f0431 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776666.641254:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ca9f140/0x26940258de8f0431 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776666.641286:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789776666.641789:0:14335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789776666.642422:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ca9f140/0x26940258de8f0431 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776666.642436:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b08000 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:1.0:1789776666.642441:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ca9f140/0x26940258de8f0431 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776666.642465:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ca9f140/0x26940258de8f0431 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776666.642486:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ca9f140/0x26940258de8f0431 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776666.642494:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ca9f140/0x26940258de8f0431 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776666.642516:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776666.642518:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789776666.642520:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789776666.646198:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789776666.646229:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4098f1e/0x26940258de8f0438 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776666.646251:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=419s v=(0 0) 00010000:00010000:0.0:1789776666.646256:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789776666.646263:0:15032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4098f1e/0x26940258de8f0438 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776666.646278:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4098f1e/0x26940258de8f0438 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776666.646288:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4098f1e/0x26940258de8f0438 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776666.646296:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4098f1e/0x26940258de8f0438 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776666.646316:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789776666.646336:0:16063:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789776666.646345:0:16063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4098f1e/0x26940258de8f0438 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776666.646353:0:16063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b08600 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:3.0:1789776666.646358:0:16063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4098f1e/0x26940258de8f0438 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776666.646390:0:16063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4098f1e/0x26940258de8f0438 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776666.646407:0:16063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4098f1e/0x26940258de8f0438 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776666.646416:0:16063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4098f1e/0x26940258de8f0438 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776666.646437:0:16063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776666.646439:0:16063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776666.646441:0:16063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789776666.650550:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789776666.650563:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065064d00/0x26940258de8f043f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776666.650581:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=419s v=(0 0) 00010000:00010000:0.0:1789776666.650593:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789776666.650600:0:15032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065064d00/0x26940258de8f043f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776666.650615:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065064d00/0x26940258de8f043f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776666.650625:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065064d00/0x26940258de8f043f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776666.650633:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065064d00/0x26940258de8f043f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776666.650659:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789776666.650699:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776666.650708:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065064d00/0x26940258de8f043f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.650717:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b08c00 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:2.0:1789776666.650723:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065064d00/0x26940258de8f043f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.650732:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065064d00/0x26940258de8f043f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.650760:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065064d00/0x26940258de8f043f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.650768:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065064d00/0x26940258de8f043f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776666.650792:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776666.650795:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776666.650797:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1789776666.652780:0:15032:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:0.0:1789776666.656175:0:15032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14372:x1876716471553920:12345-0@lo:5:osp-pre-1-0.0 Request processed in 113978us (114149us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776666.656189:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789776666.656255:0:14372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6eb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14372:1876716471553920:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789776666.656273:0:14372:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:3.0:1789776666.656572:0:14372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14372:1876716471554048:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789776666.656611:0:14372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776666.656662:0:14372:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c869067a300 going to sleep for 11 seconds 00000100:00100000:2.0:1789776666.656706:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471554048 00000100:00100000:2.0:1789776666.656714:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471554048 00000100:00100000:2.0:1789776666.656766:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789776666.656776:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14372:x1876716471554048:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1789776666.656820:0:15029:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1789776666.664575:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14372:x1876716471554048:12345-0@lo:5:osp-pre-1-0.0 Request processed in 7793us (7957us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789776666.664587:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789776666.664733:0:14372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14372:1876716471554048:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789776666.664748:0:14372:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000040:00080000:0.0:1789776666.905370:0:14381:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:1.0:1789776667.119000:0:16102:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789776667.349417:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789776668.375153:0:16063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776668.903558:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776668.903827:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462121728 00000100:00100000:2.0:1789776668.903838:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462121728 00000100:00100000:2.0:1789776668.903886:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 75 00000100:00100000:2.0:1789776668.903894:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2353:x1876716462121728:12345-192.168.202.6@tcp:250:mount.lustre.0 00010000:00080000:2.0:1789776668.903923:0:14339:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 08f86ba3-73a9-4ec6-813b-6c6b819447b1@192.168.202.6@tcp t0 exp 0000000000000000 cur 421 last 0 00000020:00000080:2.0:1789776668.903954:0:14339:0:(genops.c:1385:class_connect()) connect: client 08f86ba3-73a9-4ec6-813b-6c6b819447b1, cookie 0x26940258de8f0446 00000100:00080000:2.0:1789776668.904087:0:14339:0:(import.c:65:import_set_state_nolock()) ffff9c868e2a3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789776668.904171:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08f86ba3-73a9-4ec6-813b-6c6b819447b1+5:2353:x1876716462121728:12345-192.168.202.6@tcp:250:mount.lustre.0 Request processed in 275us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776668.904193:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 75 00000100:00100000:3.0:1789776668.908551:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776668.908648:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462121856 00000100:00100000:1.0:1789776668.908658:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462121856 00000100:00100000:1.0:1789776668.908719:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 76 00000100:00100000:1.0:1789776668.908730:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08f86ba3-73a9-4ec6-813b-6c6b819447b1+5:13736:x1876716462121856:12345-192.168.202.6@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789776668.908746:0:14342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776668.908767:0:14342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c8680031c00/0x26940258de8f044d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2aab expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776668.908807:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c8680031c00/0x26940258de8f044d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2aab expref: 6 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776668.908819:0:14342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c8680031c00/0x26940258de8f044d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2aab expref: 6 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776668.908844:0:14342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8680031c00, rc 0) 00000100:00100000:1.0:1789776668.908942:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08f86ba3-73a9-4ec6-813b-6c6b819447b1+6:13736:x1876716462121856:12345-192.168.202.6@tcp:101:mount.lustre.0 Request processed in 213us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776668.908950:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 76 00000100:00100000:1.0:1789776668.916176:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776668.916387:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462121984 00000100:00100000:2.0:1789776668.916407:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462121984 00000100:00100000:2.0:1789776668.916464:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 77 00000100:00100000:2.0:1789776668.916475:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08f86ba3-73a9-4ec6-813b-6c6b819447b1+6:13736:x1876716462121984:12345-192.168.202.6@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789776668.917547:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08f86ba3-73a9-4ec6-813b-6c6b819447b1+6:13736:x1876716462121984:12345-192.168.202.6@tcp:501:mount.lustre.0 Request processed in 1070us (1378us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789776668.917557:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 77 00000100:00100000:3.0:1789776668.922567:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776668.922677:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462122112 00000100:00100000:0.0:1789776668.922687:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462122112 00000100:00100000:0.0:1789776668.922745:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 78 00000100:00100000:0.0:1789776668.922755:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08f86ba3-73a9-4ec6-813b-6c6b819447b1+6:13736:x1876716462122112:12345-192.168.202.6@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789776668.922771:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776668.922879:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c86b9b08800/0x26940258de8f0454 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2ab2 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776668.922909:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c86b9b08800/0x26940258de8f0454 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2ab2 expref: 7 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776668.922932:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c86b9b08800/0x26940258de8f0454 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2ab2 expref: 7 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776668.922942:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86b9b08800, rc 0) 00000100:00100000:0.0:1789776668.923042:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08f86ba3-73a9-4ec6-813b-6c6b819447b1+7:13736:x1876716462122112:12345-192.168.202.6@tcp:101:mount.lustre.0 Request processed in 287us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776668.923049:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 78 00000100:00100000:0.0:1789776668.927425:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776668.927496:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462122240 00000100:00100000:2.0:1789776668.927508:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462122240 00000100:00100000:2.0:1789776668.927571:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 79 00000100:00100000:2.0:1789776668.927592:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08f86ba3-73a9-4ec6-813b-6c6b819447b1+7:13736:x1876716462122240:12345-192.168.202.6@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789776668.927901:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08f86ba3-73a9-4ec6-813b-6c6b819447b1+8:13736:x1876716462122240:12345-192.168.202.6@tcp:501:mount.lustre.0 Request processed in 312us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776668.927909:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 79 00000100:00100000:1.0:1789776668.935104:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776668.935264:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462122368 00000100:00100000:0.0:1789776668.935277:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462122368 00000100:00100000:0.0:1789776668.935342:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 80 00000100:00100000:0.0:1789776668.935353:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb4e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08f86ba3-73a9-4ec6-813b-6c6b819447b1+8:13736:x1876716462122368:12345-192.168.202.6@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789776668.935613:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb4e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08f86ba3-73a9-4ec6-813b-6c6b819447b1+8:13736:x1876716462122368:12345-192.168.202.6@tcp:503:mount.lustre.0 Request processed in 261us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776668.935621:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 80 00000100:00100000:3.0:1789776668.941018:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776668.941325:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462122496 00000100:00100000:1.0:1789776668.941335:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462122496 00000100:00100000:1.0:1789776668.941395:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 81 00000100:00100000:1.0:1789776668.941406:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af75cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08f86ba3-73a9-4ec6-813b-6c6b819447b1+8:13755:x1876716462122496:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789776668.944971:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af75cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08f86ba3-73a9-4ec6-813b-6c6b819447b1+8:13755:x1876716462122496:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 3551us (3950us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776668.944989:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 81 00000100:00100000:1.0:1789776668.970299:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776668.970674:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462122624 00000100:00100000:2.0:1789776668.970686:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462122624 00000100:00100000:2.0:1789776668.970745:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 82 00000100:00100000:2.0:1789776668.970755:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af75c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08f86ba3-73a9-4ec6-813b-6c6b819447b1+8:13755:x1876716462122624:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789776668.971047:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af75c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08f86ba3-73a9-4ec6-813b-6c6b819447b1+8:13755:x1876716462122624:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 291us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776668.971056:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 82 00000100:00100000:1.0:1789776668.989431:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776668.989558:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462122752 00000100:00100000:2.0:1789776668.989568:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462122752 00000100:00100000:2.0:1789776668.989628:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 83 00000100:00100000:2.0:1789776668.989653:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af75d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08f86ba3-73a9-4ec6-813b-6c6b819447b1+8:13736:x1876716462122752:12345-192.168.202.6@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789776668.989671:0:14342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776668.989689:0:14342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c868afc6800/0x26940258de8f045b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2adc expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776668.989718:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c868afc6800/0x26940258de8f045b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2adc expref: 9 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776668.989729:0:14342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c868afc6800/0x26940258de8f045b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2adc expref: 9 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776668.989739:0:14342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c868afc6800, rc 0) 00000100:00100000:2.0:1789776668.989839:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af75d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08f86ba3-73a9-4ec6-813b-6c6b819447b1+9:13736:x1876716462122752:12345-192.168.202.6@tcp:101:mount.lustre.0 Request processed in 188us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776668.989847:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 83 00000100:00100000:3.0:1789776669.001755:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776669.001826:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462122880 00000100:00100000:0.0:1789776669.001838:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462122880 00000100:00100000:0.0:1789776669.001963:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 84 00000100:00100000:0.0:1789776669.001976:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af75dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08f86ba3-73a9-4ec6-813b-6c6b819447b1+9:13736:x1876716462122880:12345-192.168.202.6@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789776669.002007:0:14341:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789776669.002046:0:14341:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789776669.002052:0:14341:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789776669.002065:0:14341:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789776669.002067:0:14341:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1789776669.012771:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af75dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08f86ba3-73a9-4ec6-813b-6c6b819447b1+9:13736:x1876716462122880:12345-192.168.202.6@tcp:256:mount.lustre.0 Request processed in 10787us (11012us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776669.012782:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 84 00000100:00100000:1.0:1789776669.018415:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776669.018512:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462123008 00000100:00100000:2.0:1789776669.018520:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462123008 00000100:00100000:2.0:1789776669.018592:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 85 00000100:00100000:2.0:1789776669.018600:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af75c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08f86ba3-73a9-4ec6-813b-6c6b819447b1+9:13736:x1876716462123008:12345-192.168.202.6@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789776669.018623:0:14342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776669.018637:0:14342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c868afc6600/0x26940258de8f0462 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2ae3 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776669.018661:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c868afc6600/0x26940258de8f0462 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2ae3 expref: 10 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776669.018669:0:14342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c868afc6600/0x26940258de8f0462 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2ae3 expref: 10 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776669.018692:0:14342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c868afc6600, rc 0) 00000100:00100000:2.0:1789776669.018742:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af75c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08f86ba3-73a9-4ec6-813b-6c6b819447b1+10:13736:x1876716462123008:12345-192.168.202.6@tcp:101:mount.lustre.0 Request processed in 143us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776669.018747:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 85 00000100:00100000:3.0:1789776669.026272:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776669.026429:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462123136 00000100:00100000:0.0:1789776669.026440:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462123136 00000100:00100000:0.0:1789776669.026499:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 86 00000100:00100000:0.0:1789776669.026510:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af75d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08f86ba3-73a9-4ec6-813b-6c6b819447b1+10:13736:x1876716462123136:12345-192.168.202.6@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789776669.027453:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af75d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08f86ba3-73a9-4ec6-813b-6c6b819447b1+10:13736:x1876716462123136:12345-192.168.202.6@tcp:501:mount.lustre.0 Request processed in 940us (1234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776669.027464:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 86 00000100:00100000:1.0:1789776669.031962:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776669.032311:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462123264 00000100:00100000:2.0:1789776669.032322:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462123264 00000100:00100000:2.0:1789776669.032376:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 87 00000100:00100000:2.0:1789776669.032387:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af75c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08f86ba3-73a9-4ec6-813b-6c6b819447b1+10:13736:x1876716462123264:12345-192.168.202.6@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789776669.032651:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af75c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08f86ba3-73a9-4ec6-813b-6c6b819447b1+10:13736:x1876716462123264:12345-192.168.202.6@tcp:503:mount.lustre.0 Request processed in 264us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776669.032659:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 87 00000100:00100000:1.0:1789776669.039064:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776669.039142:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462123392 00000100:00100000:0.0:1789776669.039152:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462123392 00000100:00100000:0.0:1789776669.039237:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 88 00000100:00100000:0.0:1789776669.039247:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af75e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08f86ba3-73a9-4ec6-813b-6c6b819447b1+10:13760:x1876716462123392:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789776669.039567:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af75e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08f86ba3-73a9-4ec6-813b-6c6b819447b1+10:13760:x1876716462123392:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 320us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776669.039575:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 88 00000100:00100000:1.0:1789776669.055921:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776669.056007:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462123520 00000100:00100000:3.0:1789776669.056017:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462123520 00000100:00100000:3.0:1789776669.056073:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 89 00000100:00100000:3.0:1789776669.056084:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af75f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08f86ba3-73a9-4ec6-813b-6c6b819447b1+10:13760:x1876716462123520:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789776669.056381:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af75f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08f86ba3-73a9-4ec6-813b-6c6b819447b1+10:13760:x1876716462123520:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 298us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776669.056389:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 89 00000100:00100000:1.0:1789776669.062365:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776669.062681:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462123648 00000100:00100000:3.0:1789776669.062691:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462123648 00000100:00100000:3.0:1789776669.062739:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4 00000100:00100000:3.0:1789776669.062747:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2353:x1876716462123648:12345-192.168.202.6@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789776669.062784:0:14347:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from a1367cae-ee96-4b87-865d-1591bdfc1114@192.168.202.6@tcp t0 exp 0000000000000000 cur 421 last 0 00000020:00000080:3.0:1789776669.062829:0:14347:0:(genops.c:1385:class_connect()) connect: client a1367cae-ee96-4b87-865d-1591bdfc1114, cookie 0x26940258de8f0469 00000004:00100000:3.0:1789776669.062861:0:14347:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1789776669.062868:0:14347:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1789776669.102163:0:14347:0:(import.c:65:import_set_state_nolock()) ffff9c869892e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789776669.102270:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+6:2353:x1876716462123648:12345-192.168.202.6@tcp:38:mount.lustre.0 Request processed in 39522us (39913us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776669.102281:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4 00000100:00100000:1.0:1789776669.107386:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776669.107431:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776669.107928:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462123904 00000100:00100000:3.0:1789776669.107938:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462123904 00000100:00100000:3.0:1789776669.108019:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5 00000100:00100000:3.0:1789776669.108030:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1367cae-ee96-4b87-865d-1591bdfc1114+6:13736:x1876716462123904:12345-192.168.202.6@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789776669.108077:0:14349:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789776669.108185:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1367cae-ee96-4b87-865d-1591bdfc1114+6:13736:x1876716462123904:12345-192.168.202.6@tcp:41:mount.lustre.0 Request processed in 157us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776669.108192:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5 00000100:00080000:0.0:1789776669.108305:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789776669.109029:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462123776 00000100:00100000:3.0:1789776669.109035:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462123776 00000100:00100000:3.0:1789776669.109113:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 6 00000100:00100000:3.0:1789776669.109122:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+6:0:x1876716462123776:12345-192.168.202.6@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789776669.109149:0:14347:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789776669.109189:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+6:0:x1876716462123776:12345-192.168.202.6@tcp:41:mount.lustre.0 Request processed in 69us (1758us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776669.109197:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 6 00000100:00100000:1.0:1789776669.111121:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776669.111251:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462124032 00000100:00100000:2.0:1789776669.111261:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462124032 00000100:00100000:2.0:1789776669.111350:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 7 00000100:00100000:2.0:1789776669.111360:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1367cae-ee96-4b87-865d-1591bdfc1114+6:13736:x1876716462124032:12345-192.168.202.6@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789776669.111476:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1367cae-ee96-4b87-865d-1591bdfc1114+6:13736:x1876716462124032:12345-192.168.202.6@tcp:40:mount.lustre.0 Request processed in 118us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776669.111485:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 7 00000100:00100000:0.0:1789776669.119082:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776669.119139:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776669.119177:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776669.119279:0:15032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462124160 00000100:00100000:3.0:1789776669.119301:0:15032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462124160 00000100:00100000:3.0:1789776669.119342:0:15032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462124288 00000100:00100000:3.0:1789776669.119346:0:15032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462124288 00000100:00100000:3.0:1789776669.119367:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 8 00000100:00100000:3.0:1789776669.119375:0:15032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1876716462124160:12345-192.168.202.6@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789776669.119408:0:15032:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a1367cae-ee96-4b87-865d-1591bdfc1114@192.168.202.6@tcp t0 exp 0000000000000000 cur 421 last 0 00000020:00000080:3.0:1789776669.119442:0:15032:0:(genops.c:1385:class_connect()) connect: client a1367cae-ee96-4b87-865d-1591bdfc1114, cookie 0x26940258de8f0470 00002000:00100000:3.0:1789776669.119454:0:15032:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a1367cae-ee96-4b87-865d-1591bdfc1114/ffff9c86c0241800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789776669.119477:0:15032:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789776669.119834:0:15032:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789776669.119865:0:15032:0:(import.c:65:import_set_state_nolock()) ffff9c86c0242800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789776669.119928:0:15032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1367cae-ee96-4b87-865d-1591bdfc1114+6:2353:x1876716462124160:12345-192.168.202.6@tcp:8:mount.lustre.0 Request processed in 552us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776669.119936:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 8 00000100:00100000:3.0:1789776669.119970:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 9 00000100:00100000:3.0:1789776669.119975:0:15032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1876716462124288:12345-192.168.202.6@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789776669.119991:0:15032:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a1367cae-ee96-4b87-865d-1591bdfc1114@192.168.202.6@tcp t0 exp 0000000000000000 cur 421 last 0 00000020:00000080:3.0:1789776669.120008:0:15032:0:(genops.c:1385:class_connect()) connect: client a1367cae-ee96-4b87-865d-1591bdfc1114, cookie 0x26940258de8f0477 00002000:00100000:3.0:1789776669.120013:0:15032:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a1367cae-ee96-4b87-865d-1591bdfc1114/ffff9c86c0245000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789776669.120026:0:15032:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789776669.120153:0:15032:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789776669.120168:0:15032:0:(import.c:65:import_set_state_nolock()) ffff9c86c0247000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789776669.120190:0:15032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1367cae-ee96-4b87-865d-1591bdfc1114+6:2353:x1876716462124288:12345-192.168.202.6@tcp:8:mount.lustre.0 Request processed in 213us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776669.120196:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 9 00000100:00100000:2.0:1789776669.120945:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462124416 00000100:00100000:2.0:1789776669.120952:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462124416 00000100:00100000:2.0:1789776669.120995:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 0 00000100:00100000:2.0:1789776669.121003:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+6:13736:x1876716462124416:12345-192.168.202.6@tcp:33:mount.lustre.0 00000004:00080000:2.0:1789776669.122713:0:14350:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1652us 00000004:00200000:2.0:1789776669.188778:0:14350:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789776669.189405:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+6:13736:x1876716462124416:12345-192.168.202.6@tcp:33:mount.lustre.0 Request processed in 68396us (70327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776669.189417:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 0 00010000:00010000:2.0:1789776669.398339:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776669.458314:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776669.459519:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462124544 00000100:00100000:3.0:1789776669.459531:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462124544 00000100:00100000:3.0:1789776669.459606:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 8 00000100:00100000:3.0:1789776669.459616:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+6:13781:x1876716462124544:12345-192.168.202.6@tcp:101:mkdir.0 00010000:00010000:3.0:1789776669.459637:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776669.459663:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678c00/0x26940258de8f047e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2b0d expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776669.459732:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8f0485 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776669.459746:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8f0485 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776669.459759:0:14347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8f0485 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776669.459812:0:14347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789776669.459816:0:14347:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789776669.459852:0:14347:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8f0485 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776669.459880:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678c00/0x26940258de8f047e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2b0d expref: 8 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776669.459897:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8f0485 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2b0d expref: 7 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776669.459906:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c8682cbe400) 00010000:00010000:3.0:1789776669.459909:0:14347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789776669.459913:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8681679000, rc 0) 00000100:00100000:3.0:1789776669.459987:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+7:13781:x1876716462124544:12345-192.168.202.6@tcp:101:mkdir.0 Request processed in 372us (1685us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776669.459994:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 8 00000100:00100000:1.0:1789776669.588603:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471554176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789776669.588684:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776669.588885:0:15034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471554176 00000100:00100000:0.0:1789776669.588893:0:15034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471554176 00000100:00100000:0.0:1789776669.588999:0:15034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789776669.589025:0:15034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471554176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789776669.589047:0:15034:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789776669.589095:0:15034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471554176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776669.589102:0:15034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789776669.589146:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471554176:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789776669.589595:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789776670.420979:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776671.408940:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776671.409046:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462124672 00000100:00100000:2.0:1789776671.409058:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462124672 00000100:00100000:2.0:1789776671.409163:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 9 00000100:00100000:2.0:1789776671.409176:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1367cae-ee96-4b87-865d-1591bdfc1114+7:13834:x1876716462124672:12345-192.168.202.6@tcp:41:lfs.0 00000100:00080000:3.0:1789776671.409332:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:2.0:1789776671.409396:0:14348:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789776671.409546:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1367cae-ee96-4b87-865d-1591bdfc1114+7:13834:x1876716462124672:12345-192.168.202.6@tcp:41:lfs.0 Request processed in 373us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776671.409554:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 9 00000100:00100000:0.0:1789776671.416438:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776671.417040:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462124800 00000100:00100000:1.0:1789776671.417067:0:15033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462124800 00000100:00100000:1.0:1789776671.417199:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4 00000100:00100000:1.0:1789776671.417210:0:15033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a1367cae-ee96-4b87-865d-1591bdfc1114+6:13834:x1876716462124800:12345-192.168.202.6@tcp:13:lfs.0 00002000:00000024:1.0:1789776671.417299:0:15033:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789776671.417401:0:15033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a1367cae-ee96-4b87-865d-1591bdfc1114+6:13834:x1876716462124800:12345-192.168.202.6@tcp:13:lfs.0 Request processed in 192us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776671.417409:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4 00000100:00080000:3.0:1789776671.417672:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789776671.419975:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776671.420130:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462124928 00000100:00100000:3.0:1789776671.420141:0:15033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462124928 00000100:00100000:3.0:1789776671.420301:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5 00000100:00100000:3.0:1789776671.420312:0:15033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a0b58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a1367cae-ee96-4b87-865d-1591bdfc1114+6:13834:x1876716462124928:12345-192.168.202.6@tcp:13:lfs.0 00002000:00000024:3.0:1789776671.420354:0:15033:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789776671.420454:0:15033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a0b58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a1367cae-ee96-4b87-865d-1591bdfc1114+6:13834:x1876716462124928:12345-192.168.202.6@tcp:13:lfs.0 Request processed in 132us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776671.420480:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5 00000100:00080000:0.0:1789776671.421580:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789776671.447167:0:16063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776671.657339:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a0b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471554304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789776671.657444:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776671.657517:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a0b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3275:1876716471554816:0@lo:400:kworker.0 00000100:00100000:1.0:1789776671.657549:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776671.657581:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789776671.657587:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a0b58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:3275:1876716471554432:0@lo:400:kworker.0 00000100:00100000:1.0:1789776671.657618:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776671.657641:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a0b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3275:1876716471554944:0@lo:400:kworker.0 00000100:00100000:1.0:1789776671.657662:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776671.657709:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471554816 00000100:00100000:1.0:1789776671.657719:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471554816 00000100:00100000:1.0:1789776671.657774:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471554944 00000100:00100000:1.0:1789776671.657777:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471554944 00000100:00100000:1.0:1789776671.657806:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789776671.657816:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a0b59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1876716471554816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776671.657882:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a0b59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1876716471554816:12345-0@lo:400:kworker.0 Request processed in 67us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776671.657890:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789776671.657923:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789776671.657929:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a0b5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1876716471554944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776671.657962:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a0b5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1876716471554944:12345-0@lo:400:kworker.0 Request processed in 33us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776671.657970:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789776671.657994:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471554432 00000100:00100000:1.0:1789776671.657998:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471554432 00000100:00100000:1.0:1789776671.658029:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789776671.658036:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af75e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+19:3275:x1876716471554432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776671.658071:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af75e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+19:3275:x1876716471554432:12345-0@lo:400:kworker.0 Request processed in 36us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776671.658077:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789776671.663129:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a0b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471554560:0@lo:400:kworker.0 00000100:00100000:0.0:1789776671.665482:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776671.665552:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a0b59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3273:1876716471555072:0@lo:400:kworker.0 00000100:00100000:0.0:1789776671.665601:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776671.665632:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789776671.665640:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a0b5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471554688:0@lo:400:kworker.0 00000100:00100000:0.0:1789776671.665664:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776671.665710:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471555072 00000100:00100000:0.0:1789776671.665720:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471555072 00000100:00100000:0.0:1789776671.665774:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789776671.665784:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1876716471555072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776671.665840:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1876716471555072:12345-0@lo:400:kworker.0 Request processed in 58us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776671.665847:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1789776671.665873:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789776671.665970:0:15032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471554560 00000100:00100000:0.0:1789776671.665975:0:15032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471554560 00000100:00100000:0.0:1789776671.666008:0:15032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471554688 00000100:00100000:0.0:1789776671.666011:0:15032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471554688 00000100:00100000:0.0:1789776671.666031:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789776671.666047:0:15032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471554560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776671.666081:0:15032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471554560:12345-0@lo:400:kworker.0 Request processed in 35us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776671.666088:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789776671.666101:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789776671.666120:0:15032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3273:x1876716471554688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776671.666149:0:15032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3273:x1876716471554688:12345-0@lo:400:kworker.0 Request processed in 42us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776671.666155:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1789776671.666181:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789776671.666184:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789776671.667068:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471554304 00000100:00100000:3.0:1789776671.667077:0:15033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471554304 00000100:00100000:3.0:1789776671.667125:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789776671.667134:0:15033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a0b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3275:x1876716471554304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789776671.667152:0:15033:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789776671.667202:0:15033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a0b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3275:x1876716471554304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (9758us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776671.667208:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789776671.667432:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a0b58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:3275:1876716471554432:0@lo:400:kworker.0 00000100:00100000:3.0:1789776671.667450:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a0b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3275:1876716471554944:0@lo:400:kworker.0 00000100:00100000:3.0:1789776671.667466:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a0b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471554304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789776671.667477:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a0b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3275:1876716471554816:0@lo:400:kworker.0 00000100:00100000:0.0:1789776671.669728:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a0b5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471554688:0@lo:400:kworker.0 00000100:00100000:1.0:1789776671.670876:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a0b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471554560:0@lo:400:kworker.0 00000100:00100000:1.0:1789776671.670897:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a0b59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3273:1876716471555072:0@lo:400:kworker.0 00000100:00100000:2.0:1789776671.674013:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776671.674359:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462125056 00000100:00100000:2.0:1789776671.674371:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462125056 00000100:00100000:2.0:1789776671.674435:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 91 00000100:00100000:2.0:1789776671.674446:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af75fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08f86ba3-73a9-4ec6-813b-6c6b819447b1+10:13869:x1876716462125056:12345-192.168.202.6@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789776671.674462:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776671.674483:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c868afc6e00/0x26940258de8f048c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2b14 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776671.674516:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c868afc6e00/0x26940258de8f048c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2b14 expref: 11 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776671.674528:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c868afc6e00/0x26940258de8f048c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2b14 expref: 11 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776671.674553:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c868afc6e00, rc 0) 00000100:00100000:2.0:1789776671.674612:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af75fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08f86ba3-73a9-4ec6-813b-6c6b819447b1+11:13869:x1876716462125056:12345-192.168.202.6@tcp:101:mount.lustre.0 Request processed in 168us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776671.674619:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 91 00000100:00100000:3.0:1789776671.690632:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776671.691638:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462125184 00000100:00100000:1.0:1789776671.691651:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462125184 00000100:00100000:1.0:1789776671.691724:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 92 00000100:00100000:1.0:1789776671.691735:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af75ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08f86ba3-73a9-4ec6-813b-6c6b819447b1+11:13869:x1876716462125184:12345-192.168.202.6@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789776671.692062:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af75ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08f86ba3-73a9-4ec6-813b-6c6b819447b1+11:13869:x1876716462125184:12345-192.168.202.6@tcp:501:mount.lustre.0 Request processed in 329us (1438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776671.692070:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 92 00000100:00100000:1.0:1789776671.700761:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776671.711260:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462125312 00000100:00100000:0.0:1789776671.711279:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462125312 00000100:00100000:0.0:1789776671.711399:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 93 00000100:00100000:0.0:1789776671.711410:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af75f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08f86ba3-73a9-4ec6-813b-6c6b819447b1+11:13869:x1876716462125312:12345-192.168.202.6@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789776671.711668:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af75f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08f86ba3-73a9-4ec6-813b-6c6b819447b1+11:13869:x1876716462125312:12345-192.168.202.6@tcp:503:mount.lustre.0 Request processed in 258us (10918us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776671.711678:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 93 00000100:00100000:3.0:1789776671.722590:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776671.723340:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462125440 00000100:00100000:0.0:1789776671.723352:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462125440 00000100:00100000:0.0:1789776671.723404:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 94 00000100:00100000:0.0:1789776671.723414:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af75e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08f86ba3-73a9-4ec6-813b-6c6b819447b1+11:13873:x1876716462125440:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789776671.723960:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af75e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08f86ba3-73a9-4ec6-813b-6c6b819447b1+11:13873:x1876716462125440:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 541us (1383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776671.723981:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 94 00000100:00100000:2.0:1789776671.753930:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776671.755791:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462125568 00000100:00100000:0.0:1789776671.755808:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462125568 00000100:00100000:0.0:1789776671.755923:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 95 00000100:00100000:0.0:1789776671.755936:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08f86ba3-73a9-4ec6-813b-6c6b819447b1+11:13873:x1876716462125568:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789776671.756518:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08f86ba3-73a9-4ec6-813b-6c6b819447b1+11:13873:x1876716462125568:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 582us (2601us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776671.756529:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 95 00000100:00100000:0.0:1789776671.766576:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776671.767064:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462125696 00000100:00100000:3.0:1789776671.767080:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462125696 00000100:00100000:3.0:1789776671.767322:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 96 00000100:00100000:3.0:1789776671.767338:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08f86ba3-73a9-4ec6-813b-6c6b819447b1+11:13869:x1876716462125696:12345-192.168.202.6@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789776671.767364:0:14339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776671.767395:0:14339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c8681678c00/0x26940258de8f0493 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2b3e expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776671.767467:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c8681678c00/0x26940258de8f0493 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2b3e expref: 12 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776671.767481:0:14339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c8681678c00/0x26940258de8f0493 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2b3e expref: 12 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776671.767492:0:14339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8681678c00, rc 0) 00000100:00100000:3.0:1789776671.767667:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08f86ba3-73a9-4ec6-813b-6c6b819447b1+12:13869:x1876716462125696:12345-192.168.202.6@tcp:101:mount.lustre.0 Request processed in 333us (1105us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776671.767686:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 96 00000001:00100000:1.0:1789776671.780153:0:7615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1789776671.780172:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1789776671.780453:0:7615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a1367cae-ee96-4b87-865d-1591bdfc1114 00000100:00100000:3.0:1789776671.783705:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776671.784032:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462125824 00000100:00100000:0.0:1789776671.784051:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462125824 00000100:00100000:0.0:1789776671.784385:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 97 00000100:00100000:0.0:1789776671.784399:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08f86ba3-73a9-4ec6-813b-6c6b819447b1+12:13869:x1876716462125824:12345-192.168.202.6@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789776671.784441:0:14342:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789776671.784484:0:14342:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789776671.784490:0:14342:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789776671.784493:0:14342:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789776671.784497:0:14342:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1789776671.793435:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08f86ba3-73a9-4ec6-813b-6c6b819447b1+12:13869:x1876716462125824:12345-192.168.202.6@tcp:256:mount.lustre.0 Request processed in 8683us (9382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776671.793455:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 97 00000100:00100000:1.0:1789776671.797383:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776671.797578:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462125952 00000100:00100000:0.0:1789776671.797592:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462125952 00000100:00100000:0.0:1789776671.797668:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 98 00000100:00100000:0.0:1789776671.797814:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb574050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08f86ba3-73a9-4ec6-813b-6c6b819447b1+12:13869:x1876716462125952:12345-192.168.202.6@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789776671.797836:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776671.797863:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c86b9b09a00/0x26940258de8f049a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2b45 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776671.797931:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c86b9b09a00/0x26940258de8f049a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2b45 expref: 13 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776671.797945:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c86b9b09a00/0x26940258de8f049a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2b45 expref: 13 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776671.797957:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86b9b09a00, rc 0) 00000100:00100000:0.0:1789776671.798045:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb574050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08f86ba3-73a9-4ec6-813b-6c6b819447b1+13:13869:x1876716462125952:12345-192.168.202.6@tcp:101:mount.lustre.0 Request processed in 236us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776671.800703:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776671.800789:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462126080 00000100:00100000:3.0:1789776671.800812:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462126080 00000100:00100000:3.0:1789776671.800873:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 99 00000100:00100000:3.0:1789776671.800885:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb577450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08f86ba3-73a9-4ec6-813b-6c6b819447b1+14:13869:x1876716462126080:12345-192.168.202.6@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789776671.801433:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb577450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08f86ba3-73a9-4ec6-813b-6c6b819447b1+14:13869:x1876716462126080:12345-192.168.202.6@tcp:501:mount.lustre.0 Request processed in 548us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776671.801444:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 99 00000100:00100000:1.0:1789776671.803819:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776671.803918:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462126208 00000100:00100000:3.0:1789776671.803931:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462126208 00000100:00100000:3.0:1789776671.803997:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 100 00000100:00100000:3.0:1789776671.804008:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08f86ba3-73a9-4ec6-813b-6c6b819447b1+14:13869:x1876716462126208:12345-192.168.202.6@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789776671.804465:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08f86ba3-73a9-4ec6-813b-6c6b819447b1+14:13869:x1876716462126208:12345-192.168.202.6@tcp:503:mount.lustre.0 Request processed in 456us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776671.804474:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 100 00000100:00100000:1.0:1789776671.807824:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776671.808300:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462126336 00000100:00100000:3.0:1789776671.808315:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462126336 00000100:00100000:3.0:1789776671.808390:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 101 00000100:00100000:3.0:1789776671.808403:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb577c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08f86ba3-73a9-4ec6-813b-6c6b819447b1+14:13876:x1876716462126336:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789776671.808831:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb577c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08f86ba3-73a9-4ec6-813b-6c6b819447b1+14:13876:x1876716462126336:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 430us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776671.808841:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 101 00000100:00100000:0.0:1789776671.810591:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 98 00000100:00100000:1.0:1789776671.824639:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776671.826056:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462126464 00000100:00100000:3.0:1789776671.826076:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462126464 00000100:00100000:3.0:1789776671.826292:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 102 00000100:00100000:3.0:1789776671.826307:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08f86ba3-73a9-4ec6-813b-6c6b819447b1+13:13876:x1876716462126464:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789776671.826683:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08f86ba3-73a9-4ec6-813b-6c6b819447b1+13:13876:x1876716462126464:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 368us (2047us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776671.826692:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 102 00000100:00100000:1.0:1789776671.840160:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776671.840208:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776671.840286:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776671.840332:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776671.840420:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462126592 00000100:00100000:0.0:1789776671.840434:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462126592 00000100:00100000:0.0:1789776671.840486:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462126976 00000100:00100000:0.0:1789776671.840489:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462126976 00000100:00100000:0.0:1789776671.840527:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 16 00000100:00100000:0.0:1789776671.840540:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a0b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+7:2356:x1876716462126976:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1789776671.840661:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a0b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+7:2356:x1876716462126976:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 123us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776671.840680:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 16 00000100:00100000:0.0:1789776671.840702:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00100000:0.0:1789776671.840707:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a0b59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2353:x1876716462126592:12345-192.168.202.6@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789776671.840737:0:14347:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 83b46197-9c3c-40cf-ad07-7480b68e6519@192.168.202.6@tcp t0 exp 0000000000000000 cur 424 last 0 00000020:00000080:0.0:1789776671.840790:0:14347:0:(genops.c:1385:class_connect()) connect: client 83b46197-9c3c-40cf-ad07-7480b68e6519, cookie 0x26940258de8f04a1 00000004:00100000:0.0:1789776671.840841:0:14347:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789776671.840993:0:14347:0:(import.c:65:import_set_state_nolock()) ffff9c85832ed800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789776671.841040:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a0b59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83b46197-9c3c-40cf-ad07-7480b68e6519+6:2353:x1876716462126592:12345-192.168.202.6@tcp:38:mount.lustre.0 Request processed in 331us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776671.841048:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00100000:0.0:1789776671.841076:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462127232 00000100:00100000:0.0:1789776671.841081:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462127232 00000100:00100000:0.0:1789776671.841118:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462127104 00000100:00100000:0.0:1789776671.841122:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462127104 00000100:00100000:0.0:1789776671.841142:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4 00000100:00100000:0.0:1789776671.841149:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a0b5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+5:2356:x1876716462127232:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1789776671.841178:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a0b5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+5:2356:x1876716462127232:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 30us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776671.841186:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4 00000100:00100000:0.0:1789776671.841197:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5 00000100:00100000:0.0:1789776671.841204:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a0b59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+6:2356:x1876716462127104:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1789776671.841259:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a0b59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+6:2356:x1876716462127104:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 56us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776671.841266:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5 00000100:00100000:1.0:1789776671.851978:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776671.852194:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462126848 00000100:00100000:0.0:1789776671.852209:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462126848 00000100:00100000:0.0:1789776671.852359:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 11 00000100:00100000:0.0:1789776671.852372:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a0b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83b46197-9c3c-40cf-ad07-7480b68e6519+6:13869:x1876716462126848:12345-192.168.202.6@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789776671.852420:0:14347:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789776671.852530:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a0b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83b46197-9c3c-40cf-ad07-7480b68e6519+6:13869:x1876716462126848:12345-192.168.202.6@tcp:41:mount.lustre.0 Request processed in 160us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776671.852538:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 11 00000100:00080000:2.0:1789776671.852709:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789776671.854161:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776671.854328:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462126720 00000100:00100000:2.0:1789776671.854339:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462126720 00000100:00100000:2.0:1789776671.854400:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 12 00000100:00100000:2.0:1789776671.854411:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83b46197-9c3c-40cf-ad07-7480b68e6519+6:0:x1876716462126720:12345-192.168.202.6@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789776671.854444:0:14349:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789776671.854514:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83b46197-9c3c-40cf-ad07-7480b68e6519+6:0:x1876716462126720:12345-192.168.202.6@tcp:41:mount.lustre.0 Request processed in 104us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776671.854522:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 12 00000100:00100000:3.0:1789776671.870971:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776671.871964:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462127360 00000100:00100000:2.0:1789776671.871982:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462127360 00000100:00100000:2.0:1789776671.872151:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 13 00000100:00100000:2.0:1789776671.872164:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83b46197-9c3c-40cf-ad07-7480b68e6519+6:13869:x1876716462127360:12345-192.168.202.6@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789776671.872353:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83b46197-9c3c-40cf-ad07-7480b68e6519+6:13869:x1876716462127360:12345-192.168.202.6@tcp:40:mount.lustre.0 Request processed in 191us (1397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776671.872387:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 13 00000100:00100000:3.0:1789776671.879368:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776671.879498:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776671.880596:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776671.881604:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462127488 00000100:00100000:1.0:1789776671.881621:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462127488 00000100:00100000:1.0:1789776671.881691:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462127616 00000100:00100000:1.0:1789776671.881694:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462127616 00000100:00100000:1.0:1789776671.881718:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00100000:1.0:1789776671.881729:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1876716462127488:12345-192.168.202.6@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789776671.881913:0:15029:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 83b46197-9c3c-40cf-ad07-7480b68e6519@192.168.202.6@tcp t0 exp 0000000000000000 cur 424 last 0 00000020:00000080:1.0:1789776671.881953:0:15029:0:(genops.c:1385:class_connect()) connect: client 83b46197-9c3c-40cf-ad07-7480b68e6519, cookie 0x26940258de8f04a8 00002000:00100000:1.0:1789776671.881970:0:15029:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 83b46197-9c3c-40cf-ad07-7480b68e6519/ffff9c8683f79800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789776671.881984:0:15029:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789776671.882355:0:15029:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789776671.882403:0:15029:0:(import.c:65:import_set_state_nolock()) ffff9c86aa6ce000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789776671.882560:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83b46197-9c3c-40cf-ad07-7480b68e6519+6:2353:x1876716462127488:12345-192.168.202.6@tcp:8:mount.lustre.0 Request processed in 831us (3060us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776671.882570:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00100000:1.0:1789776671.882594:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 11 00000100:00100000:1.0:1789776671.882599:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1876716462127616:12345-192.168.202.6@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789776671.882639:0:15029:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 83b46197-9c3c-40cf-ad07-7480b68e6519@192.168.202.6@tcp t0 exp 0000000000000000 cur 424 last 0 00000020:00000080:1.0:1789776671.882661:0:15029:0:(genops.c:1385:class_connect()) connect: client 83b46197-9c3c-40cf-ad07-7480b68e6519, cookie 0x26940258de8f04af 00002000:00100000:1.0:1789776671.882668:0:15029:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 83b46197-9c3c-40cf-ad07-7480b68e6519/ffff9c86aa6ca000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789776671.882689:0:15029:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789776671.883017:0:15029:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789776671.883039:0:15029:0:(import.c:65:import_set_state_nolock()) ffff9c86b641e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789776671.883068:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83b46197-9c3c-40cf-ad07-7480b68e6519+6:2353:x1876716462127616:12345-192.168.202.6@tcp:8:mount.lustre.0 Request processed in 467us (2480us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776671.883075:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 11 00000100:00100000:0.0:1789776671.883620:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462127744 00000100:00100000:0.0:1789776671.883628:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462127744 00000100:00100000:0.0:1789776671.883692:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1 00000100:00100000:0.0:1789776671.883701:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83b46197-9c3c-40cf-ad07-7480b68e6519+6:13869:x1876716462127744:12345-192.168.202.6@tcp:33:mount.lustre.0 00000004:00200000:0.0:1789776671.883989:0:14351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789776671.884055:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83b46197-9c3c-40cf-ad07-7480b68e6519+6:13869:x1876716462127744:12345-192.168.202.6@tcp:33:mount.lustre.0 Request processed in 356us (4701us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776671.884065:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1 00000100:00100000:0.0:1789776672.040628:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776672.040806:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462127872 00000100:00100000:2.0:1789776672.040822:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462127872 00000100:00100000:2.0:1789776672.040908:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 14 00000100:00100000:2.0:1789776672.040920:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83b46197-9c3c-40cf-ad07-7480b68e6519+6:13897:x1876716462127872:12345-192.168.202.6@tcp:101:mkdir.0 00010000:00010000:2.0:1789776672.040950:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776672.040982:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6000/0x26940258de8f04b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2b6f expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776672.041071:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7c00/0x26940258de8f04bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776672.041089:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7c00/0x26940258de8f04bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776672.041126:0:14347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7c00/0x26940258de8f04bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776672.041173:0:14347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789776672.041177:0:14347:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789776672.041204:0:14347:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7c00/0x26940258de8f04bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776672.041271:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6000/0x26940258de8f04b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2b6f expref: 8 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776672.041294:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7c00/0x26940258de8f04bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2b6f expref: 7 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776672.041333:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c8682cbe400) 00010000:00010000:2.0:1789776672.041336:0:14347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789776672.041341:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c868afc7c00, rc 0) 00000100:00100000:2.0:1789776672.041423:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83b46197-9c3c-40cf-ad07-7480b68e6519+7:13897:x1876716462127872:12345-192.168.202.6@tcp:101:mkdir.0 Request processed in 504us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776672.041431:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 14 00010000:00010000:2.0:1789776672.469982:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776673.493125:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789776673.821618:0:6684:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 83b46197-9c3c-40cf-ad07-7480b68e6519 00000001:00100000:2.0:1789776673.821649:0:6684:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a1367cae-ee96-4b87-865d-1591bdfc1114 00000001:00100000:2.0:1789776674.281425:0:5833:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 83b46197-9c3c-40cf-ad07-7480b68e6519 00000001:00100000:2.0:1789776674.281445:0:5833:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a1367cae-ee96-4b87-865d-1591bdfc1114 00010000:00010000:1.0:1789776674.521511:0:16063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776674.710597:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471555200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789776674.713829:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776674.713961:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471555200 00000100:00100000:3.0:1789776674.713970:0:15033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471555200 00000100:00100000:3.0:1789776674.714032:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789776674.714048:0:15033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471555200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789776674.714108:0:15033:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789776674.714190:0:15033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471555200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776674.714212:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789776674.714303:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471555200:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789776674.714362:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1789776675.152633:0:16308:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1789776675.540425:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789776676.128045:0:14381:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789776676.565552:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776676.759896:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a0b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471555456:0@lo:400:kworker.0 00000100:00100000:3.0:1789776676.760368:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a0b5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:3275:1876716471555328:0@lo:400:kworker.0 00000100:00100000:3.0:1789776676.760484:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776676.760555:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a0b5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3275:1876716471555840:0@lo:400:kworker.0 00000100:00100000:3.0:1789776676.760587:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776676.760652:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471555840 00000100:00100000:3.0:1789776676.760662:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471555840 00000100:00100000:3.0:1789776676.760759:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789776676.760771:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1876716471555840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776676.760834:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1876716471555840:12345-0@lo:400:kworker.0 Request processed in 65us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776676.760841:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1789776676.760867:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789776676.761040:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a0b5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3275:1876716471555840:0@lo:400:kworker.0 00000100:00100000:0.0:1789776676.762021:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a0b58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3274:1876716471555712:0@lo:400:kworker.0 00000100:00100000:0.0:1789776676.762093:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776676.762133:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789776676.762141:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a0b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471555584:0@lo:400:kworker.0 00000100:00100000:0.0:1789776676.762171:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776676.762243:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471555712 00000100:00100000:0.0:1789776676.762250:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471555712 00000100:00100000:0.0:1789776676.762299:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789776676.762309:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1876716471555712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776676.762364:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1876716471555712:12345-0@lo:400:kworker.0 Request processed in 56us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776676.762371:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789776676.762417:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a0b58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3274:1876716471555712:0@lo:400:kworker.0 00000100:00100000:0.0:1789776676.762453:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471555328 00000100:00100000:0.0:1789776676.762457:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471555328 00000100:00100000:0.0:1789776676.762489:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789776676.762496:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+19:3275:x1876716471555328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776676.762548:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+19:3275:x1876716471555328:12345-0@lo:400:kworker.0 Request processed in 52us (2065us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776676.762554:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789776676.762598:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a0b5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:3275:1876716471555328:0@lo:400:kworker.0 00000100:00100000:0.0:1789776676.762633:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471555584 00000100:00100000:0.0:1789776676.762637:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471555584 00000100:00100000:0.0:1789776676.762678:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789776676.762685:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471555584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776676.762736:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3274:x1876716471555584:12345-0@lo:400:kworker.0 Request processed in 53us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776676.762743:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1789776676.762769:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789776676.762790:0:3274:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1789776676.762807:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a0b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3274:1876716471555584:0@lo:400:kworker.0 00000100:00100000:1.0:1789776676.763313:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776676.763345:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a0b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3276:1876716471555968:0@lo:400:kworker.0 00000100:00100000:1.0:1789776676.763369:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776676.763408:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471555968 00000100:00100000:1.0:1789776676.763412:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471555968 00000100:00100000:1.0:1789776676.763449:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789776676.763455:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a0b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876716471555968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776676.763493:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a0b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1876716471555968:12345-0@lo:400:kworker.0 Request processed in 37us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776676.763500:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1789776676.763516:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789776676.763536:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a0b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3276:1876716471555968:0@lo:400:kworker.0 00000100:00100000:0.0:1789776676.764044:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471555456 00000100:00100000:0.0:1789776676.764050:0:15031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471555456 00000100:00100000:0.0:1789776676.766357:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789776676.766390:0:15031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a0b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471555456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776676.766522:0:15031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a0b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3276:x1876716471555456:12345-0@lo:400:kworker.0 Request processed in 151us (3209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776676.766529:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789776676.766581:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471556096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789776676.766633:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776676.766697:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471556096 00000100:00100000:0.0:1789776676.766706:0:15033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471556096 00000100:00100000:0.0:1789776676.766757:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789776676.766763:0:15033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471556096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789776676.766800:0:15033:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789776676.766839:0:15033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471556096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776676.766845:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789776676.766895:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471556096:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789776676.769185:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789776676.770160:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a0b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3276:1876716471555456:0@lo:400:kworker.0 00000001:00100000:1.0:1789776676.873016:0:7615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 83b46197-9c3c-40cf-ad07-7480b68e6519 00000100:00100000:1.0:1789776677.156845:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776677.156943:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776677.156968:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776677.156996:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776677.157022:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776677.157045:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776677.169474:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776677.169526:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462128384 00000100:00100000:1.0:1789776677.169538:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462128384 00000100:00100000:1.0:1789776677.169602:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462128640 00000100:00100000:1.0:1789776677.169606:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462128640 00000100:00100000:1.0:1789776677.169622:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462128256 00000100:00100000:1.0:1789776677.169625:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462128256 00000100:00100000:1.0:1789776677.169637:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462128768 00000100:00100000:1.0:1789776677.169639:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462128768 00000100:00100000:1.0:1789776677.169657:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 8 00000100:00100000:1.0:1789776677.169670:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a0b59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+5:2355:x1876716462128384:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1789776677.169780:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a0b59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+5:2355:x1876716462128384:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 112us (12836us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776677.169788:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 8 00000100:00100000:1.0:1789776677.169807:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 9 00000100:00100000:1.0:1789776677.169813:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a0b58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83b46197-9c3c-40cf-ad07-7480b68e6519+5:2355:x1876716462128640:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1789776677.169839:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a0b58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83b46197-9c3c-40cf-ad07-7480b68e6519+5:2355:x1876716462128640:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 27us (12871us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776677.169845:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 9 00000100:00100000:1.0:1789776677.169856:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00100000:1.0:1789776677.169871:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a0b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+5:2355:x1876716462128256:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1789776677.169897:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a0b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+5:2355:x1876716462128256:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 27us (12875us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776677.169902:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00100000:1.0:1789776677.169913:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 11 00000100:00100000:1.0:1789776677.169919:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a0b58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83b46197-9c3c-40cf-ad07-7480b68e6519+5:2355:x1876716462128768:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1789776677.169941:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a0b58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83b46197-9c3c-40cf-ad07-7480b68e6519+5:2355:x1876716462128768:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 22us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776677.169947:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 11 00000100:00100000:1.0:1789776677.169974:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462128000 00000100:00100000:1.0:1789776677.169979:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462128000 00000100:00100000:1.0:1789776677.170009:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 104 00000100:00100000:1.0:1789776677.170015:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08f86ba3-73a9-4ec6-813b-6c6b819447b1+13:2355:x1876716462128000:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1789776677.170042:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08f86ba3-73a9-4ec6-813b-6c6b819447b1+13:2355:x1876716462128000:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 27us (13044us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776677.170048:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 104 00000100:00100000:0.0:1789776677.172937:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462128128 00000100:00100000:0.0:1789776677.172964:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462128128 00000100:00100000:0.0:1789776677.173076:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462128512 00000100:00100000:0.0:1789776677.173079:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462128512 00000100:00100000:0.0:1789776677.173115:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 20 00000100:00100000:0.0:1789776677.173127:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a0b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1367cae-ee96-4b87-865d-1591bdfc1114+6:2355:x1876716462128128:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1789776677.173257:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a0b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1367cae-ee96-4b87-865d-1591bdfc1114+6:2355:x1876716462128128:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 131us (16423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776677.173266:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 20 00000100:00100000:0.0:1789776677.173709:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 21 00000100:00100000:0.0:1789776677.173731:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a0b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83b46197-9c3c-40cf-ad07-7480b68e6519+6:2355:x1876716462128512:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1789776677.173926:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a0b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83b46197-9c3c-40cf-ad07-7480b68e6519+6:2355:x1876716462128512:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 198us (16879us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776677.173934:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 21 00000100:00080000:0.0:1789776677.174862:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789776677.174873:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789776677.174876:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789776677.595443:0:16063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776678.627131:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776679.636623:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789776679.776172:0:16455:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffde40a4630 20000000:00000080:2.0:1789776679.776201:0:16455:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c8581cbd800 uarg=0000000000000000 20000000:01000000:2.0:1789776679.776281:0:16455:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789776679.776290:0:16455:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789776679.776296:0:16455:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789776679.781994:0:16456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1789776679.783883:0:16455:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789776679.800695:0:16455:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789776679.801545:0:16455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c8680030a00/0x26940258de8f04c4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776679.801576:0:16455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c86bf5ca600/0x26940258de8f01bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8f01b4 expref: 18 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776679.801586:0:16455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c8681678200/0x26940258de8f0208 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8f0201 expref: 18 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776679.801594:0:16455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c8686775000/0x26940258de8f033c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8f0335 expref: 18 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776679.801624:0:16455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c868afc6600/0x26940258de8f0462 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2ae3 expref: 12 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776679.801632:0:16455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c86b9b09a00/0x26940258de8f049a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2b45 expref: 12 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776679.801640:0:16455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c8680030a00/0x26940258de8f04c4 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776679.801702:0:16455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c86b9b09a00/0x26940258de8f049a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2b45 expref: 12 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776679.801725:0:16455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c86b9b09a00/0x26940258de8f049a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2b45 expref: 12 pid: 14341 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776679.801746:0:16455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a0b5b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16455:1876716471556224:192.168.202.6@tcp:104: 00010000:00010000:1.0:1789776679.801900:0:16455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c868afc6600/0x26940258de8f0462 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2ae3 expref: 12 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776679.801909:0:16455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c868afc6600/0x26940258de8f0462 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2ae3 expref: 12 pid: 14342 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776679.801918:0:16455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a01ddf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16455:1876716471556352:192.168.202.6@tcp:104: 00010000:00010000:1.0:1789776679.801951:0:16455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c8686775000/0x26940258de8f033c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26940258de8f0335 expref: 18 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776679.801959:0:16455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c8686775000/0x26940258de8f033c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26940258de8f0335 expref: 18 pid: 14339 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776679.801981:0:16455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a01dea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16455:1876716471556480:0@lo:104: 00000100:00100000:1.0:1789776679.802032:0:16455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789776679.802091:0:16455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c8681678200/0x26940258de8f0208 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26940258de8f0201 expref: 18 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776679.802100:0:16455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c8681678200/0x26940258de8f0208 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26940258de8f0201 expref: 18 pid: 14342 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776679.802108:0:16455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a01dd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16455:1876716471556608:0@lo:104: 00000100:00100000:1.0:1789776679.802128:0:16455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776679.802187:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471556480 00000100:00100000:1.0:1789776679.802197:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471556480 00000100:00100000:1.0:1789776679.802278:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471556608 00000100:00100000:1.0:1789776679.802281:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471556608 00000100:00100000:1.0:1789776679.802298:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789776679.802307:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+4:16455:x1876716471556480:12345-0@lo:104: 00010000:00010000:1.0:1789776679.802321:0:14331:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c8681679200/0x26940258de8f0335 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8f033c expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776679.802675:0:14331:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789776679.802682:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+4:16455:x1876716471556480:12345-0@lo:104: Request processed in 375us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776679.802691:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789776679.802711:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789776679.802718:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+3:16455:x1876716471556608:12345-0@lo:104: 00010000:00010000:1.0:1789776679.802727:0:14331:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c8681679a00/0x26940258de8f0201 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8f0208 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776679.802772:0:14331:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789776679.802777:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+3:16455:x1876716471556608:12345-0@lo:104: Request processed in 61us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776679.802784:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1789776679.802825:0:16455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c86bf5ca600/0x26940258de8f01bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26940258de8f01b4 expref: 18 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776679.802835:0:16455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c86bf5ca600/0x26940258de8f01bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26940258de8f01b4 expref: 18 pid: 14341 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776679.802843:0:16455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a01dd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16455:1876716471556736:0@lo:104: 00000100:00100000:1.0:1789776679.802873:0:16455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776679.802902:0:14331:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789776679.802914:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471556736 00000100:00100000:1.0:1789776679.802917:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471556736 00000100:00100000:1.0:1789776679.802936:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789776679.802942:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b5ac8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+3:16455:x1876716471556736:12345-0@lo:104: 00010000:00010000:1.0:1789776679.802950:0:14331:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c8681678800/0x26940258de8f01b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8f01bb expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776679.802983:0:14331:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789776679.802987:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b5ac8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+3:16455:x1876716471556736:12345-0@lo:104: Request processed in 46us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776679.802993:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789776679.803052:0:16455:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8682de1240 going to sleep for 11 seconds 00000100:00100000:1.0:1789776679.803079:0:16455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a01dea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16455:1876716471556480:0@lo:104: 00000100:00100000:1.0:1789776679.803088:0:16455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a01dd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16455:1876716471556608:0@lo:104: 00000100:00100000:1.0:1789776679.803103:0:16455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a01dd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16455:1876716471556736:0@lo:104: 00010000:00010000:2.0:1789776679.803386:0:14335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789776679.803395:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c8681679200/0x26940258de8f0335 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8f033c expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776679.803419:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681679200 already unused, calling callback (ffffffffc1da0c20) 10000000:00010000:2.0:1789776679.803424:0:14335:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c8681679200/0x26940258de8f0335 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x26940258de8f033c expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776679.803434:0:14335:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c8681679200/0x26940258de8f0335 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x26940258de8f033c expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776679.803443:0:14335:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c8681679200/0x26940258de8f0335 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x26940258de8f033c expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776679.803450:0:14335:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789776679.803489:0:14335:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c8681679200/0x26940258de8f0335 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8f033c expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776679.803496:0:14335:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789776679.803521:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c8681679200/0x26940258de8f0335 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8f033c expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776679.803528:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c8681679200/0x26940258de8f0335 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8f033c expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776679.803547:0:14335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789776679.803550:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c8681679a00/0x26940258de8f0201 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8f0208 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776679.803555:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681679a00 already unused, calling callback (ffffffffc1da0c20) 10000000:00010000:2.0:1789776679.803558:0:14335:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c8681679a00/0x26940258de8f0201 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x26940258de8f0208 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776679.803575:0:14335:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c8681679a00/0x26940258de8f0201 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x26940258de8f0208 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776679.803582:0:14335:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c8681679a00/0x26940258de8f0201 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x26940258de8f0208 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776679.803587:0:14335:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789776679.803601:0:14335:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c8681679a00/0x26940258de8f0201 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8f0208 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776679.803607:0:14335:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789776679.803625:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c8681679a00/0x26940258de8f0201 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8f0208 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776679.803633:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c8681679a00/0x26940258de8f0201 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8f0208 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776679.803644:0:14335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776679.803647:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c8681678800/0x26940258de8f01b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26940258de8f01bb expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776679.803652:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681678800 already unused, calling callback (ffffffffc1da0c20) 10000000:00010000:2.0:1789776679.803655:0:14335:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c8681678800/0x26940258de8f01b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26940258de8f01bb expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776679.803661:0:14335:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c8681678800/0x26940258de8f01b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26940258de8f01bb expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789776679.803667:0:14335:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c8681678800/0x26940258de8f01b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26940258de8f01bb expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789776679.803679:0:14335:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789776679.803694:0:14335:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c8681678800/0x26940258de8f01b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8f01bb expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776679.803700:0:14335:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789776679.803706:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c8681678800/0x26940258de8f01b4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8f01bb expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776679.803712:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c8681678800/0x26940258de8f01b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26940258de8f01bb expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776679.803726:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776679.803728:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776679.803730:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789776679.803756:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:3274:1876716471556864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789776679.803800:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776679.803846:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:3275:1876716471556992:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789776679.803870:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776679.803892:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789776679.803898:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86ba6eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:3275:1876716471557120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789776679.803921:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776679.803958:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471556864 00000100:00100000:2.0:1789776679.803964:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471556864 00010000:00010000:2.0:1789776679.803992:0:14334:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c8686775000/0x26940258de8f033c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8f0335 expref: 19 pid: 14339 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776679.804010:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471556992 00000100:00100000:2.0:1789776679.804012:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471556992 00010000:00010000:2.0:1789776679.804032:0:14334:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c8681678200/0x26940258de8f0208 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8f0201 expref: 20 pid: 14342 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776679.804058:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471557120 00000100:00100000:2.0:1789776679.804061:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471557120 00010000:00010000:2.0:1789776679.804075:0:14334:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c86bf5ca600/0x26940258de8f01bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8f01b4 expref: 21 pid: 14341 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776679.804088:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789776679.804094:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba6eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+21:3274:x1876716471556864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789776679.804107:0:14334:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776679.804114:0:14334:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c8686775000/0x26940258de8f033c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8f0335 expref: 21 pid: 14339 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776679.804125:0:14334:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c8686775000/0x26940258de8f033c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26940258de8f0335 expref: 21 pid: 14339 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776679.804141:0:14334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c8686775000/0x26940258de8f033c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26940258de8f0335 expref: 21 pid: 14339 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776679.804157:0:14334:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776679.804200:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba6eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+20:3274:x1876716471556864:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776679.804207:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789776679.804258:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789776679.804265:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+19:3275:x1876716471556992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789776679.804273:0:14334:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776679.804277:0:14334:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c8681678200/0x26940258de8f0208 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8f0201 expref: 19 pid: 14342 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776679.804295:0:14334:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c8681678200/0x26940258de8f0208 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26940258de8f0201 expref: 19 pid: 14342 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776679.804306:0:14334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c8681678200/0x26940258de8f0208 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26940258de8f0201 expref: 19 pid: 14342 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776679.804313:0:14334:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776679.804342:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+18:3275:x1876716471556992:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776679.804348:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789776679.804362:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789776679.804367:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf745050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+17:3275:x1876716471557120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789776679.804375:0:14334:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776679.804379:0:14334:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c86bf5ca600/0x26940258de8f01bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26940258de8f01b4 expref: 17 pid: 14341 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776679.804387:0:14334:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c86bf5ca600/0x26940258de8f01bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26940258de8f01b4 expref: 17 pid: 14341 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776679.804397:0:14334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c86bf5ca600/0x26940258de8f01bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26940258de8f01b4 expref: 17 pid: 14341 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776679.804406:0:14334:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776679.804426:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf745050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+16:3275:x1876716471557120:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776679.804432:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789776679.804497:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:3274:1876716471556864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789776679.804525:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:3275:1876716471557120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789776679.804540:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86ba6e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:3275:1876716471556992:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789776679.804854:0:16063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776679.806038:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776679.810585:0:16455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a0b5b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16455:1876716471556224:192.168.202.6@tcp:104: 00000100:00100000:3.0:1789776679.810604:0:16455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a01ddf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16455:1876716471556352:192.168.202.6@tcp:104: 00010000:00010000:3.0:1789776679.810651:0:16455:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c8680030a00/0x26940258de8f04c4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776679.820589:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776679.820712:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776679.823009:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462128896 00000100:00100000:3.0:1789776679.823030:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462128896 00010000:00010000:3.0:1789776679.823474:0:14332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c86b9b09a00/0x26940258de8f049a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2b45 expref: 13 pid: 14341 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776679.823520:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462129024 00000100:00100000:3.0:1789776679.823525:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462129024 00010000:00010000:3.0:1789776679.823541:0:14332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c868afc6600/0x26940258de8f0462 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2ae3 expref: 14 pid: 14342 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776679.823557:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 7 00000100:00100000:3.0:1789776679.823567:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08f86ba3-73a9-4ec6-813b-6c6b819447b1+14:2357:x1876716462128896:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789776679.823587:0:14332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789776679.823593:0:14332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c86b9b09a00/0x26940258de8f049a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2b45 expref: 14 pid: 14341 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776679.823608:0:14332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c86b9b09a00/0x26940258de8f049a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2b45 expref: 14 pid: 14341 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776679.823632:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c86b9b09a00/0x26940258de8f049a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2b45 expref: 14 pid: 14341 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776679.823653:0:14332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776679.823763:0:14334:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789776679.823776:0:14334:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1789776679.824594:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 8 00000100:00100000:1.0:1789776679.824615:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08f86ba3-73a9-4ec6-813b-6c6b819447b1+13:2357:x1876716462129024:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776679.824629:0:14334:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776679.824636:0:14334:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c868afc6600/0x26940258de8f0462 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2ae3 expref: 13 pid: 14342 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776679.824649:0:14334:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c868afc6600/0x26940258de8f0462 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2ae3 expref: 13 pid: 14342 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776679.824664:0:14334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c868afc6600/0x26940258de8f0462 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2ae3 expref: 13 pid: 14342 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776679.824691:0:14334:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c8680030a00/0x26940258de8f04c4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776679.824701:0:14334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c8680030a00/0x26940258de8f04c4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776679.824720:0:14334:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c8680030a00/0x26940258de8f04c4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776679.824727:0:14334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c8680030a00/0x26940258de8f04c4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776679.824735:0:14334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c8680030a00/0x26940258de8f04c4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776679.824756:0:14334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c8680030a00/0x26940258de8f04c4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776679.824763:0:14334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8680030a00 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:1.0:1789776679.824767:0:14334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c8680030a00/0x26940258de8f04c4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776679.824777:0:14334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c8680030a00/0x26940258de8f04c4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776679.824794:0:14334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c8680030a00/0x26940258de8f04c4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776679.824807:0:14334:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789776679.825563:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08f86ba3-73a9-4ec6-813b-6c6b819447b1+12:2357:x1876716462128896:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 1990us (4985us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776679.825574:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 7 00010000:00010000:2.0:1789776679.826730:0:16455:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c8680030a00/0x26940258de8f04c4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776679.826748:0:16455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c8680030a00/0x26940258de8f04c4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776679.826756:0:16455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c8680030a00/0x26940258de8f04c4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776679.839611:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08f86ba3-73a9-4ec6-813b-6c6b819447b1+11:2357:x1876716462129024:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 14988us (18879us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776679.839630:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 8 00000100:00100000:2.0:1789776679.840291:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471557248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789776679.840376:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789776679.840824:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471557248 00000100:00100000:3.0:1789776679.840836:0:15033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471557248 00000100:00100000:3.0:1789776679.840912:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789776679.840923:0:15033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471557248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789776679.840971:0:15033:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789776679.841062:0:15033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471557248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776679.841070:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789776679.841112:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471557248:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789776679.842142:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789776680.663717:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789776681.493297:0:14344:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789776681.493308:0:14344:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c86beb07800 from 10 10000000:01000000:1.0:1789776681.493316:0:14344:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789776681.493377:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8680030600/0x26940258de8f04cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776681.493391:0:14344:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c8680030600/0x26940258de8f04cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776681.493404:0:14344:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c8680030600/0x26940258de8f04cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776681.493436:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a01df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14344:1876716471557376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789776681.493538:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776681.493618:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86aa6eaf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789776681.493785:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471557376 00000100:00100000:0.0:1789776681.493796:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471557376 00000100:00100000:0.0:1789776681.493868:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789776681.493880:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+16:14344:x1876716471557376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789776681.493898:0:14339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776681.493917:0:14339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c86b9b08600/0x26940258de8f04d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8f04cb expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776681.493946:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c86b9b08600/0x26940258de8f04d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8f04cb expref: 17 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776681.493956:0:14339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c86b9b08600/0x26940258de8f04d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8f04cb expref: 17 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776681.493968:0:14339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86b9b08600, rc 0) 00000100:00100000:0.0:1789776681.494038:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+17:14344:x1876716471557376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776681.494045:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789776681.494398:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a01df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14344:1876716471557376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789776681.494418:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c8680030600/0x26940258de8f04cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f04d2 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776681.494428:0:14344:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c8680030600/0x26940258de8f04cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8f04d2 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776681.494508:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86af5dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14344:1876716471557504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776681.494555:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776681.494579:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8691e44cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776681.494692:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471557504 00000100:00100000:1.0:1789776681.494698:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471557504 00000100:00100000:1.0:1789776681.494740:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789776681.494748:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb576050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+17:14344:x1876716471557504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789776681.495083:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb576050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+17:14344:x1876716471557504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 336us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776681.495092:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789776681.495314:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86af5dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14344:1876716471557504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776681.495365:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86af5dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14344:1876716471557632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789776681.495411:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776681.495431:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8691e44cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776681.495589:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471557632 00000100:00100000:0.0:1789776681.495594:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471557632 00000100:00100000:0.0:1789776681.495640:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789776681.495648:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb576450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+17:14344:x1876716471557632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789776681.496081:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb576450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+17:14344:x1876716471557632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 433us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776681.496090:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789776681.496169:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86af5dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14344:1876716471557632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789776681.497342:0:16511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789776681.497850:0:14344:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789776681.497878:0:14344:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789776681.497892:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8680030600/0x26940258de8f04cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f04d2 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776681.497904:0:14344:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c8680030600/0x26940258de8f04cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f04d2 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789776681.497917:0:14344:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789776681.497920:0:14344:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c86bc8e4800 from 10 10000000:01000000:1.0:1789776681.497923:0:14344:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789776681.497972:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8680030800/0x26940258de8f04d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776681.497981:0:14344:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c8680030800/0x26940258de8f04d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776681.497994:0:14344:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c8680030800/0x26940258de8f04d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776681.498037:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a01dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14344:1876716471557760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789776681.498144:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776681.498189:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf22b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789776681.498375:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471557760 00000100:00100000:2.0:1789776681.498384:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471557760 00000100:00100000:2.0:1789776681.498473:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789776681.498485:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+17:14344:x1876716471557760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789776681.498502:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776681.498519:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c868afc6200/0x26940258de8f04e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8f04d9 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776681.498560:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c868afc6200/0x26940258de8f04e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8f04d9 expref: 18 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776681.498572:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c868afc6200/0x26940258de8f04e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8f04d9 expref: 18 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776681.498583:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c868afc6200, rc 0) 00000100:00100000:2.0:1789776681.498635:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+18:14344:x1876716471557760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776681.498642:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789776681.501605:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a01dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14344:1876716471557760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789776681.501643:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c8680030800/0x26940258de8f04d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f04e0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776681.501659:0:14344:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c8680030800/0x26940258de8f04d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8f04e0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776681.501785:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a01dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14344:1876716471557888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789776681.501864:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776681.505100:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf22b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776681.505245:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471557888 00000100:00100000:0.0:1789776681.505270:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471557888 00000100:00100000:0.0:1789776681.505335:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789776681.505347:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bb574450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+18:14344:x1876716471557888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789776681.507738:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bb574450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+18:14344:x1876716471557888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2369us (5849us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776681.507756:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789776681.508639:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a01dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14344:1876716471557888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789776681.509005:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a01dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14344:1876716471558016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789776681.509097:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776681.509130:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf22b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776681.509416:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471558016 00000100:00100000:0.0:1789776681.509424:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471558016 00000100:00100000:0.0:1789776681.509472:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789776681.509483:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8691f52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+18:14344:x1876716471558016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789776681.510530:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8691f52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+18:14344:x1876716471558016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1042us (1427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776681.510623:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789776681.510800:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a01dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14344:1876716471558016:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789776681.512001:0:16513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1789776681.512098:0:14344:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1789776681.512121:0:14344:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789776681.512136:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c8680030800/0x26940258de8f04d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f04e0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776681.512150:0:14344:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c8680030800/0x26940258de8f04d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f04e0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789776681.512163:0:14344:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789776681.512166:0:14344:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c8688152000 from 10 10000000:01000000:0.0:1789776681.512169:0:14344:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789776681.512385:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c86b9b09e00/0x26940258de8f04e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776681.512409:0:14344:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c86b9b09e00/0x26940258de8f04e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776681.512422:0:14344:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c86b9b09e00/0x26940258de8f04e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776681.512451:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14344:1876716471558144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789776681.512527:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776681.512654:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86a03aea80 going to sleep for 11 seconds 00000100:00100000:2.0:1789776681.513832:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471558144 00000100:00100000:2.0:1789776681.513845:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471558144 00000100:00100000:2.0:1789776681.513907:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789776681.513919:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8691f52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+18:14344:x1876716471558144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789776681.513946:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776681.513968:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c868afc7e00/0x26940258de8f04ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x26940258de8f04e7 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776681.514002:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c868afc7e00/0x26940258de8f04ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26940258de8f04e7 expref: 19 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776681.514016:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c868afc7e00/0x26940258de8f04ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26940258de8f04e7 expref: 19 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776681.514036:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c868afc7e00, rc 0) 00000100:00100000:2.0:1789776681.514121:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8691f52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+19:14344:x1876716471558144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 204us (1594us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776681.514128:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789776681.514272:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14344:1876716471558144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789776681.514295:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c86b9b09e00/0x26940258de8f04e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f04ee expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776681.514305:0:14344:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c86b9b09e00/0x26940258de8f04e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x26940258de8f04ee expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776681.514384:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86af5dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14344:1876716471558272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776681.514419:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776681.514438:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8691e44540 going to sleep for 11 seconds 00000100:00100000:2.0:1789776681.514468:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471558272 00000100:00100000:2.0:1789776681.514472:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471558272 00000100:00100000:2.0:1789776681.514490:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789776681.514496:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba880850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+19:14344:x1876716471558272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789776681.516431:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba880850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+19:14344:x1876716471558272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1925us (2002us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776681.516446:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789776681.516915:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86af5dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14344:1876716471558272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789776681.516984:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e78700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14344:1876716471558400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789776681.517062:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776681.517100:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86a03aea80 going to sleep for 11 seconds 00000100:00100000:2.0:1789776681.517659:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471558400 00000100:00100000:2.0:1789776681.517667:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471558400 00000100:00100000:2.0:1789776681.518386:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789776681.518399:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+19:14344:x1876716471558400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789776681.518988:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+19:14344:x1876716471558400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 590us (1924us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776681.518997:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789776681.523435:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e78700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:14344:1876716471558400:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789776681.525363:0:16514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789776681.525858:0:14344:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789776681.525887:0:14344:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789776681.525903:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c86b9b09e00/0x26940258de8f04e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f04ee expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776681.525917:0:14344:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c86b9b09e00/0x26940258de8f04e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26940258de8f04ee expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776681.566888:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776681.567000:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462129152 00000100:00100000:3.0:1789776681.567015:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462129152 00000100:00100000:3.0:1789776681.567101:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 114 00000100:00100000:3.0:1789776681.567113:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08f86ba3-73a9-4ec6-813b-6c6b819447b1+11:13750:x1876716462129152:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789776681.567136:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776681.567167:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c8686774600/0x26940258de8f04f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2b76 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776681.567238:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c8686774600/0x26940258de8f04f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2b76 expref: 12 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776681.567253:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c8686774600/0x26940258de8f04f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2b76 expref: 12 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776681.567263:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8686774600, rc 0) 00000100:00100000:3.0:1789776681.567335:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08f86ba3-73a9-4ec6-813b-6c6b819447b1+12:13750:x1876716462129152:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 225us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776681.567343:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 114 00000100:00100000:1.0:1789776681.576141:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776681.576332:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462129280 00000100:00100000:3.0:1789776681.576346:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462129280 00000100:00100000:3.0:1789776681.576417:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 115 00000100:00100000:3.0:1789776681.576429:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08f86ba3-73a9-4ec6-813b-6c6b819447b1+12:13750:x1876716462129280:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789776681.577049:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08f86ba3-73a9-4ec6-813b-6c6b819447b1+12:13750:x1876716462129280:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 619us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776681.577058:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 115 00000100:00100000:1.0:1789776681.592903:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776681.600379:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462129408 00000100:00100000:0.0:1789776681.600402:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462129408 00000100:00100000:0.0:1789776681.600486:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 116 00000100:00100000:0.0:1789776681.600500:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08f86ba3-73a9-4ec6-813b-6c6b819447b1+12:13750:x1876716462129408:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789776681.601014:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08f86ba3-73a9-4ec6-813b-6c6b819447b1+12:13750:x1876716462129408:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 Request processed in 515us (8123us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776681.601034:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 116 00000100:00100000:1.0:1789776681.614420:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776681.614705:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462129536 00000100:00100000:3.0:1789776681.614719:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462129536 00000100:00100000:3.0:1789776681.614789:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 117 00000100:00100000:3.0:1789776681.614801:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08f86ba3-73a9-4ec6-813b-6c6b819447b1+12:13750:x1876716462129536:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789776681.614823:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776681.614848:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c8686775200/0x26940258de8f04fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2b7d expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776681.614887:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c8686775200/0x26940258de8f04fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2b7d expref: 13 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776681.614899:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c8686775200/0x26940258de8f04fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2b7d expref: 13 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776681.614910:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8686775200, rc 0) 00000100:00100000:3.0:1789776681.614985:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08f86ba3-73a9-4ec6-813b-6c6b819447b1+13:13750:x1876716462129536:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 186us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776681.614992:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 117 00000100:00100000:3.0:1789776681.655875:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776681.655925:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462129664 00000100:00100000:3.0:1789776681.655949:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462129664 00000100:00100000:3.0:1789776681.656014:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 118 00000100:00100000:3.0:1789776681.656039:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08f86ba3-73a9-4ec6-813b-6c6b819447b1+13:13750:x1876716462129664:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789776681.656540:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08f86ba3-73a9-4ec6-813b-6c6b819447b1+13:13750:x1876716462129664:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 514us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776681.656550:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 118 00000100:00100000:0.0:1789776681.663441:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776681.663496:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462129792 00000100:00100000:0.0:1789776681.663524:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462129792 00000100:00100000:0.0:1789776681.663598:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 119 00000100:00100000:0.0:1789776681.663612:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08f86ba3-73a9-4ec6-813b-6c6b819447b1+13:13750:x1876716462129792:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789776681.666081:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08f86ba3-73a9-4ec6-813b-6c6b819447b1+13:13750:x1876716462129792:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 Request processed in 2455us (2639us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776681.666098:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 119 00010000:00010000:0.0:1789776681.707836:0:16063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776681.876541:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a01dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3273:1876716471558912:0@lo:400:kworker.0 00000100:00100000:1.0:1789776681.876640:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776681.876853:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789776681.876861:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a01df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471558528:0@lo:400:kworker.0 00000100:00100000:1.0:1789776681.876897:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776681.876946:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a01de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3273:1876716471559040:0@lo:400:kworker.0 00000100:00100000:1.0:1789776681.876972:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776681.877002:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a01ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471558656:0@lo:400:kworker.0 00000100:00100000:1.0:1789776681.877041:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776681.877068:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789776681.877074:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a01dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3275:1876716471558784:0@lo:400:kworker.0 00000100:00100000:1.0:1789776681.877336:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776681.877384:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471558912 00000100:00100000:1.0:1789776681.877394:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471558912 00000100:00100000:1.0:1789776681.877456:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471559040 00000100:00100000:1.0:1789776681.877460:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471559040 00000100:00100000:1.0:1789776681.877475:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471558784 00000100:00100000:1.0:1789776681.877478:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471558784 00000100:00100000:1.0:1789776681.877495:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789776681.877505:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1876716471558912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776681.877567:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3273:x1876716471558912:12345-0@lo:400:kworker.0 Request processed in 62us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776681.877576:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789776681.877594:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789776681.877600:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1876716471559040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776681.877629:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3273:x1876716471559040:12345-0@lo:400:kworker.0 Request processed in 29us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776681.877635:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789776681.877646:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789776681.877651:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1876716471558784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776681.877945:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1876716471558784:12345-0@lo:400:kworker.0 Request processed in 292us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776681.877967:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789776681.880298:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471558528 00000100:00100000:1.0:1789776681.880313:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471558528 00000100:00100000:1.0:1789776681.880372:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471558656 00000100:00100000:1.0:1789776681.880375:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471558656 00000100:00100000:1.0:1789776681.880404:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789776681.880415:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471558528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776681.880518:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471558528:12345-0@lo:400:kworker.0 Request processed in 105us (3620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776681.880526:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789776681.880546:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789776681.880553:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471558656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789776681.880584:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471558656:12345-0@lo:400:kworker.0 Request processed in 32us (3542us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776681.880589:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1789776681.880623:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789776681.880628:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789776681.880631:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789776681.880662:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86b9e7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471559168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789776681.882478:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776681.882592:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a01dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3275:1876716471558784:0@lo:400:kworker.0 00000100:00100000:1.0:1789776681.882607:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a01ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471558656:0@lo:400:kworker.0 00000100:00100000:3.0:1789776681.882862:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471559168 00000100:00100000:3.0:1789776681.882871:0:15033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471559168 00000100:00100000:3.0:1789776681.882930:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789776681.882939:0:15033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471559168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789776681.882982:0:15033:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789776681.883070:0:15033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471559168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776681.883078:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789776681.883824:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a01df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471558528:0@lo:400:kworker.0 00000100:00100000:1.0:1789776681.883856:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a01de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3273:1876716471559040:0@lo:400:kworker.0 00000100:00100000:1.0:1789776681.883870:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a01dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3273:1876716471558912:0@lo:400:kworker.0 00000100:00100000:1.0:1789776681.883944:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86b9e7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471559168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789776682.277611:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776682.277662:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776682.277696:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776682.277731:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776682.277763:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776682.277786:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776682.278489:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462130048 00000100:00100000:1.0:1789776682.278504:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462130048 00000100:00100000:1.0:1789776682.278581:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462130560 00000100:00100000:1.0:1789776682.278584:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462130560 00000100:00100000:1.0:1789776682.278598:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462130176 00000100:00100000:1.0:1789776682.278601:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462130176 00000100:00100000:1.0:1789776682.278614:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462130432 00000100:00100000:1.0:1789776682.278617:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462130432 00000100:00100000:1.0:1789776682.278636:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 14 00000100:00100000:1.0:1789776682.278648:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+5:2356:x1876716462130048:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1789776682.278792:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+5:2356:x1876716462130048:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 145us (1197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776682.278802:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 14 00000100:00100000:1.0:1789776682.278823:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 15 00000100:00100000:1.0:1789776682.278830:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83b46197-9c3c-40cf-ad07-7480b68e6519+5:2356:x1876716462130560:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1789776682.278858:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83b46197-9c3c-40cf-ad07-7480b68e6519+5:2356:x1876716462130560:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 29us (1161us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776682.278863:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 15 00000100:00100000:1.0:1789776682.278873:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 16 00000100:00100000:1.0:1789776682.278879:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+5:2356:x1876716462130176:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1789776682.278902:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+5:2356:x1876716462130176:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 23us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776682.278908:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 16 00000100:00100000:1.0:1789776682.278918:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 17 00000100:00100000:1.0:1789776682.278948:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83b46197-9c3c-40cf-ad07-7480b68e6519+5:2356:x1876716462130432:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1789776682.278975:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83b46197-9c3c-40cf-ad07-7480b68e6519+5:2356:x1876716462130432:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 30us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776682.278981:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 17 00000100:00100000:1.0:1789776682.279005:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462130304 00000100:00100000:1.0:1789776682.279008:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462130304 00000100:00100000:1.0:1789776682.279051:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462129920 00000100:00100000:1.0:1789776682.279054:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462129920 00000100:00100000:1.0:1789776682.279073:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 25 00000100:00100000:1.0:1789776682.279079:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83b46197-9c3c-40cf-ad07-7480b68e6519+6:2356:x1876716462130304:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1789776682.279124:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83b46197-9c3c-40cf-ad07-7480b68e6519+6:2356:x1876716462130304:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 44us (1462us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776682.279131:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 25 00000100:00100000:1.0:1789776682.279144:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 26 00000100:00100000:1.0:1789776682.279151:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1367cae-ee96-4b87-865d-1591bdfc1114+6:2356:x1876716462129920:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1789776682.279177:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1367cae-ee96-4b87-865d-1591bdfc1114+6:2356:x1876716462129920:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 27us (1445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776682.279183:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 26 00000100:00080000:3.0:1789776682.283918:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789776682.283934:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789776682.283939:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789776682.727753:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776683.733025:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776684.274394:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776684.274546:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462130688 00000100:00100000:1.0:1789776684.274571:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462130688 00000100:00100000:1.0:1789776684.274697:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 15 00000100:00100000:1.0:1789776684.274712:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1367cae-ee96-4b87-865d-1591bdfc1114+6:14408:x1876716462130688:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789776684.274741:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776684.274778:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031600/0x26940258de8f0503 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2b84 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.274917:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030a00/0x26940258de8f050a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.274939:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030a00/0x26940258de8f050a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.274960:0:14349:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030a00/0x26940258de8f050a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.274979:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030400/0x26940258de8f0511 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.274988:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030400/0x26940258de8f0511 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.274995:0:14349:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030400/0x26940258de8f0511 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.275545:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030200/0x26940258de8f0518 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.275557:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030200/0x26940258de8f0518 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.275566:0:14349:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030200/0x26940258de8f0518 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776684.275601:0:14349:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789776684.275606:0:14349:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789776684.275653:0:14349:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030200/0x26940258de8f0518 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.275680:0:14349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030a00/0x26940258de8f050a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.275687:0:14349:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030a00/0x26940258de8f050a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.275696:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030a00/0x26940258de8f050a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.275703:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8680030a00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776684.275709:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030a00/0x26940258de8f050a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.275716:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030a00/0x26940258de8f050a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.275732:0:14349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c8682cbe400) 00010000:00010000:1.0:1789776684.275735:0:14349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776684.275740:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030a00/0x26940258de8f050a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.275748:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030a00/0x26940258de8f050a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.275764:0:14349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030400/0x26940258de8f0511 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.275770:0:14349:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030400/0x26940258de8f0511 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.275776:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030400/0x26940258de8f0511 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.275787:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8680030400 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776684.275791:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030400/0x26940258de8f0511 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.275798:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030400/0x26940258de8f0511 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.275807:0:14349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9c8686bffd00) 00010000:00010000:1.0:1789776684.275810:0:14349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776684.275812:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030400/0x26940258de8f0511 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.275819:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030400/0x26940258de8f0511 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.275866:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031600/0x26940258de8f0503 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2b84 expref: 8 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.275885:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030200/0x26940258de8f0518 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2b84 expref: 7 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.275893:0:14349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c8686bffe00) 00010000:00010000:1.0:1789776684.275896:0:14349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789776684.275899:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8680030200, rc 0) 00000100:00080000:3.0:1789776684.277373:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789776684.279507:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1367cae-ee96-4b87-865d-1591bdfc1114+7:14408:x1876716462130688:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 4778us (5111us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776684.279525:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 15 00000100:00100000:1.0:1789776684.290592:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776684.291533:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462130944 00000100:00100000:2.0:1789776684.291548:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462130944 00000100:00100000:2.0:1789776684.291642:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 16 00000100:00100000:2.0:1789776684.291664:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1367cae-ee96-4b87-865d-1591bdfc1114+7:14408:x1876716462130944:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789776684.291768:0:14348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776684.291801:0:14348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7800/0x26940258de8f051f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2b8b expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.292320:0:14348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8f0526 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.292341:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8f0526 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.292356:0:14348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8f0526 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.292528:0:14348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f052d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.292555:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f052d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.292568:0:14348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f052d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.292977:0:14348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7600/0x26940258de8f0534 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.292986:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7600/0x26940258de8f0534 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.292994:0:14348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7600/0x26940258de8f0534 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776684.293277:0:14348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1789776684.293498:0:14348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8f0526 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.293679:0:14348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8f0526 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.293689:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8f0526 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.293696:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc6a00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776684.293701:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8f0526 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.293721:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8f0526 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.293736:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c8686bffe00) 00010000:00010000:2.0:1789776684.293739:0:14348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776684.293745:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8f0526 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.293752:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8f0526 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.293866:0:14348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f052d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.293874:0:14348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f052d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.293881:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f052d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.293886:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc7200 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776684.293890:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f052d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.293896:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f052d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.293904:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9c869055f300) 00010000:00010000:2.0:1789776684.293906:0:14348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776684.293910:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f052d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.293925:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f052d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.294747:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7800/0x26940258de8f051f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2b8b expref: 10 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.294766:0:14348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7600/0x26940258de8f0534 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2b8b expref: 9 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.294774:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c869055f400) 00010000:00010000:2.0:1789776684.294777:0:14348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776684.294779:0:14348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c868afc7600, rc 0) 00000100:00100000:2.0:1789776684.295059:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1367cae-ee96-4b87-865d-1591bdfc1114+9:14408:x1876716462130944:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 3405us (4481us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789776684.295069:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 16 00000100:00100000:2.0:1789776684.307602:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776684.310123:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462131072 00000100:00100000:1.0:1789776684.310147:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462131072 00000100:00100000:1.0:1789776684.310316:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 17 00000100:00100000:1.0:1789776684.310329:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1367cae-ee96-4b87-865d-1591bdfc1114+9:14408:x1876716462131072:12345-192.168.202.6@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789776684.310506:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1367cae-ee96-4b87-865d-1591bdfc1114+9:14408:x1876716462131072:12345-192.168.202.6@tcp:59:lhsmtool_posix.0 Request processed in 179us (2916us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776684.310515:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 17 00000100:00100000:3.0:1789776684.392542:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776684.401541:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462131200 00000100:00100000:2.0:1789776684.401569:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462131200 00000100:00100000:2.0:1789776684.401690:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 18 00000100:00100000:2.0:1789776684.401702:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a0b5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1367cae-ee96-4b87-865d-1591bdfc1114+9:14414:x1876716462131200:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1789776684.401729:0:14348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776684.401756:0:14348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7800/0x26940258de8f0542 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2b92 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.402047:0:14348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f0549 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.402088:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f0549 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.402101:0:14348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f0549 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.402120:0:14348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8f0550 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.402126:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8f0550 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.402133:0:14348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8f0550 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.404921:0:14348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f0549 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.404954:0:14348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f0549 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.404963:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f0549 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.404969:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc7200 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776684.404975:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f0549 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.404984:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f0549 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.405015:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c8682cbe400) 00010000:00010000:2.0:1789776684.405032:0:14348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776684.405039:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f0549 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.405046:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f0549 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.405067:0:14348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8f0550 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.405073:0:14348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8f0550 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.405079:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8f0550 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.405084:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc6a00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776684.405087:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8f0550 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.405093:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8f0550 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.405102:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c869055f300) 00010000:00010000:2.0:1789776684.405114:0:14348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776684.405118:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8f0550 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.405123:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8f0550 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.405188:0:14348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7800/0x26940258de8f0542 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2b92 expref: 10 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.405209:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c8682cbe400) 00010000:00010000:2.0:1789776684.405211:0:14348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776684.405279:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7800/0x26940258de8f0542 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2b92 expref: 10 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.405291:0:14348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c868afc7800, rc 0) 00000100:00100000:2.0:1789776684.407232:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a0b5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1367cae-ee96-4b87-865d-1591bdfc1114+9:14414:x1876716462131200:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 5499us (14674us total) trans 0 rc 301/301 00000100:00100000:2.0:1789776684.407249:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 18 00000100:00100000:0.0:1789776684.429737:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776684.429929:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462131328 00000100:00100000:1.0:1789776684.429953:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462131328 00000100:00100000:1.0:1789776684.430030:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 0 00000100:00100000:1.0:1789776684.430043:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a1367cae-ee96-4b87-865d-1591bdfc1114+9:14414:x1876716462131328:12345-192.168.202.6@tcp:700:lfs.0 00000100:00100000:1.0:1789776684.430257:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a1367cae-ee96-4b87-865d-1591bdfc1114+9:14414:x1876716462131328:12345-192.168.202.6@tcp:700:lfs.0 Request processed in 216us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776684.430266:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 0 00000100:00100000:3.0:1789776684.435142:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776684.435504:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462131584 00000100:00100000:2.0:1789776684.435519:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462131584 00000100:00100000:2.0:1789776684.435599:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 19 00000100:00100000:2.0:1789776684.435612:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+9:14414:x1876716462131584:12345-192.168.202.6@tcp:36:lfs.0 00010000:00010000:2.0:1789776684.435709:0:14347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776684.435748:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8f0485 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2b0d expref: 9 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.435777:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c8682cbe400) 00010000:00010000:2.0:1789776684.435785:0:14347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789776684.436559:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8f0557 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.436581:0:14347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7c00/0x26940258de8f04bd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2b6f expref: 5 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.436593:0:14347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8f0557 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.436650:0:14347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7c00/0x26940258de8f04bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2b6f expref: 5 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.436681:0:14347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7c00/0x26940258de8f04bd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2b6f expref: 5 pid: 14347 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776684.436707:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86af5df800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14347:1876716471559296:192.168.202.6@tcp:104: 00000100:00100000:2.0:1789776684.436915:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf2c9240 going to sleep for 11 seconds 00000100:00100000:0.0:1789776684.446012:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86af5df800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14347:1876716471559296:192.168.202.6@tcp:104: 00010000:00010000:0.0:1789776684.446060:0:14347:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8f0557 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776684.446951:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776684.447568:0:16457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462131712 00000100:00100000:0.0:1789776684.447582:0:16457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462131712 00010000:00010000:0.0:1789776684.447666:0:16457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7c00/0x26940258de8f04bd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2b6f expref: 6 pid: 14347 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776684.447709:0:16457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 9 00000100:00100000:0.0:1789776684.447721:0:16457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83b46197-9c3c-40cf-ad07-7480b68e6519+6:2356:x1876716462131712:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789776684.447743:0:16457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789776684.447751:0:16457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7c00/0x26940258de8f04bd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2b6f expref: 6 pid: 14347 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776684.447766:0:16457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7c00/0x26940258de8f04bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2b6f expref: 6 pid: 14347 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776684.447808:0:16457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7c00/0x26940258de8f04bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2b6f expref: 6 pid: 14347 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776684.447844:0:16457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c8682cbe400) 00010000:00010000:0.0:1789776684.447851:0:16457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8f0557 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776684.447861:0:16457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8f0557 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776684.447870:0:16457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8f0557 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776684.447901:0:16457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789776684.447972:0:16457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83b46197-9c3c-40cf-ad07-7480b68e6519+5:2356:x1876716462131712:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 252us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776684.447980:0:16457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 9 00010000:00010000:0.0:1789776684.448144:0:14347:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8f0557 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776684.448154:0:14347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8f0557 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776684.448187:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09400/0x26940258de8f055e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776684.448198:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09400/0x26940258de8f055e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776684.448207:0:14347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09400/0x26940258de8f055e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776684.449782:0:14347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789776684.449811:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8f0557 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776684.449822:0:14347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8f0557 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776684.449830:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8f0557 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776684.449837:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc6a00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776684.449842:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8f0557 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776684.449850:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8f0557 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776684.449868:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c8682cbe400) 00010000:00010000:0.0:1789776684.449871:0:14347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789776684.449876:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8f0557 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776684.449882:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8f0557 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789776684.449905:0:14347:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a9d64bce reply state 000000002a3e6697 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09400/0x26940258de8f055e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776684.449914:0:14347:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789776684.450039:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+10:14414:x1876716462131584:12345-192.168.202.6@tcp:36:lfs.0 Request processed in 14425us (14908us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789776684.450051:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 19 00000100:00080000:3.0:1789776684.451194:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789776684.466443:0:3260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09400/0x26940258de8f055e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.466482:0:3260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09400/0x26940258de8f055e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.466491:0:3260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09400/0x26940258de8f055e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.466499:0:3260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b09400 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776684.466506:0:3260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09400/0x26940258de8f055e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.466525:0:3260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09400/0x26940258de8f055e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.466552:0:3260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c8698294800) 00010000:00010000:2.0:1789776684.466556:0:3260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776684.466563:0:3260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09400/0x26940258de8f055e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.466597:0:3260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09400/0x26940258de8f055e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789776684.556043:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934593 is committed 00000100:00100000:0.0:1789776684.587797:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776684.588136:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462131840 00000100:00100000:2.0:1789776684.588151:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462131840 00000100:00100000:2.0:1789776684.588284:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 20 00000100:00100000:2.0:1789776684.588296:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1367cae-ee96-4b87-865d-1591bdfc1114+8:14422:x1876716462131840:12345-192.168.202.6@tcp:101:lctl.0 00010000:00010000:2.0:1789776684.588333:0:14348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776684.588369:0:14348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f0565 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2b99 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.588477:0:14348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6400/0x26940258de8f056c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.588497:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6400/0x26940258de8f056c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.588512:0:14348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6400/0x26940258de8f056c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776684.588575:0:14348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789776684.588580:0:14348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789776684.588645:0:14348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6400/0x26940258de8f056c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.588679:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f0565 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2b99 expref: 10 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.588702:0:14348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6400/0x26940258de8f056c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2b99 expref: 9 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.588733:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c869055f500) 00010000:00010000:2.0:1789776684.588737:0:14348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789776684.588742:0:14348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c868afc6400, rc 0) 00000100:00100000:2.0:1789776684.590350:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1367cae-ee96-4b87-865d-1591bdfc1114+9:14422:x1876716462131840:12345-192.168.202.6@tcp:101:lctl.0 Request processed in 2041us (2571us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776684.590364:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 20 00000100:00100000:3.0:1789776684.631084:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776684.631519:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462131968 00000100:00100000:0.0:1789776684.631544:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462131968 00000100:00100000:0.0:1789776684.631645:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 21 00000100:00100000:0.0:1789776684.631668:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83b46197-9c3c-40cf-ad07-7480b68e6519+5:14423:x1876716462131968:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1789776684.631695:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776684.631723:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08000/0x26940258de8f0573 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2ba0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776684.632141:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8f057a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776684.632164:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8f057a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776684.632180:0:14347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8f057a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776684.633677:0:14347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789776684.633687:0:14347:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789776684.633729:0:14347:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8f057a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.633900:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08000/0x26940258de8f0573 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2ba0 expref: 7 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.633946:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08a00/0x26940258de8f057a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2ba0 expref: 6 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.633958:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c869055f500) 00010000:00010000:2.0:1789776684.633961:0:14347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789776684.633966:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86b9b08a00, rc 0) 00000100:00100000:2.0:1789776684.634426:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83b46197-9c3c-40cf-ad07-7480b68e6519+6:14423:x1876716462131968:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 2758us (3357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776684.634437:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 21 00000100:00100000:1.0:1789776684.645299:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776684.645422:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462132096 00000100:00100000:2.0:1789776684.645437:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462132096 00000100:00100000:2.0:1789776684.645510:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 22 00000100:00100000:2.0:1789776684.645535:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83b46197-9c3c-40cf-ad07-7480b68e6519+6:14423:x1876716462132096:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1789776684.645586:0:14348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776684.645626:0:14348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f0581 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2ba7 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.645716:0:14348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7a00/0x26940258de8f0588 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.645735:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7a00/0x26940258de8f0588 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.645750:0:14348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7a00/0x26940258de8f0588 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.645767:0:14348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6000/0x26940258de8f058f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.645774:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6000/0x26940258de8f058f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.645783:0:14348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6000/0x26940258de8f058f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.646776:0:14348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6600/0x26940258de8f0596 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.646804:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6600/0x26940258de8f0596 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.646818:0:14348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6600/0x26940258de8f0596 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776684.646867:0:14348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789776684.646885:0:14348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789776684.646915:0:14348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6600/0x26940258de8f0596 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.646929:0:14348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7a00/0x26940258de8f0588 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.646936:0:14348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7a00/0x26940258de8f0588 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.646943:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7a00/0x26940258de8f0588 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.646950:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc7a00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776684.646955:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7a00/0x26940258de8f0588 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.646964:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7a00/0x26940258de8f0588 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.646978:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c869055f500) 00010000:00010000:2.0:1789776684.646981:0:14348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776684.646986:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7a00/0x26940258de8f0588 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.646993:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7a00/0x26940258de8f0588 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.647024:0:14348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6000/0x26940258de8f058f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.647031:0:14348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6000/0x26940258de8f058f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.647047:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6000/0x26940258de8f058f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.647051:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc6000 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776684.647054:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6000/0x26940258de8f058f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.647060:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6000/0x26940258de8f058f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.647068:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c869055f300) 00010000:00010000:2.0:1789776684.647071:0:14348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776684.647074:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6000/0x26940258de8f058f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.647079:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6000/0x26940258de8f058f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.647420:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f0581 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2ba7 expref: 8 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.647571:0:14348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6600/0x26940258de8f0596 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2ba7 expref: 7 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.647579:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c869055fe00) 00010000:00010000:2.0:1789776684.647581:0:14348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789776684.647584:0:14348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c868afc6600, rc 0) 00000100:00100000:2.0:1789776684.647664:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83b46197-9c3c-40cf-ad07-7480b68e6519+7:14423:x1876716462132096:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 2131us (2380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776684.647684:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 22 00000100:00100000:0.0:1789776684.662968:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776684.665364:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462132352 00000100:00100000:2.0:1789776684.665380:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462132352 00000100:00100000:2.0:1789776684.665473:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 23 00000100:00100000:2.0:1789776684.665483:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86b9e7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83b46197-9c3c-40cf-ad07-7480b68e6519+7:14423:x1876716462132352:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1789776684.665510:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776684.665532:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f059d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2bae expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776684.665619:0:14347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789776684.665741:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f059d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2bae expref: 9 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.665756:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c869055f500) 00010000:00010000:2.0:1789776684.665759:0:14347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789776684.665764:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f059d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2bae expref: 9 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.665778:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c868afc7200, rc 0) 00000100:00100000:2.0:1789776684.665843:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86b9e7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83b46197-9c3c-40cf-ad07-7480b68e6519+8:14423:x1876716462132352:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 361us (2896us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1789776684.665849:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 23 00000100:00100000:3.0:1789776684.672476:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776684.672739:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462132608 00000100:00100000:1.0:1789776684.672754:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462132608 00000100:00100000:1.0:1789776684.672835:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 24 00000100:00100000:1.0:1789776684.672848:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83b46197-9c3c-40cf-ad07-7480b68e6519+8:14423:x1876716462132608:12345-192.168.202.6@tcp:36:lfs.0 00010000:00010000:1.0:1789776684.672933:0:14349:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776684.672972:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6600/0x26940258de8f0596 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2ba7 expref: 8 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.672997:0:14349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c869055fe00) 00010000:00010000:1.0:1789776684.673025:0:14349:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789776684.673059:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031600/0x26940258de8f05ab lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.673094:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031600/0x26940258de8f05ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.673105:0:14349:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031600/0x26940258de8f05ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789776684.673434:0:14349:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002f38b438 reply state 000000002e94117a transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031600/0x26940258de8f05ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776684.673447:0:14349:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789776684.673457:0:14349:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789776684.673590:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83b46197-9c3c-40cf-ad07-7480b68e6519+9:14423:x1876716462132608:12345-192.168.202.6@tcp:36:lfs.0 Request processed in 743us (1128us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1789776684.673598:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 24 00000100:00100000:0.0:1789776684.679582:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00010000:2.0:1789776684.679753:0:3259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031600/0x26940258de8f05ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.679767:0:3259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031600/0x26940258de8f05ab lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.679786:0:3259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031600/0x26940258de8f05ab lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.679792:0:3259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8680031600 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776684.679797:0:3259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031600/0x26940258de8f05ab lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.679805:0:3259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031600/0x26940258de8f05ab lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.679824:0:3259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c8686bffd00) 00010000:00010000:2.0:1789776684.679828:0:3259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1789776684.679833:0:3259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031600/0x26940258de8f05ab lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.679841:0:3259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680031600/0x26940258de8f05ab lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776684.679897:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462132864 00000100:00100000:3.0:1789776684.679916:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462132864 00000100:00100000:3.0:1789776684.679995:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 2 00000100:00100000:3.0:1789776684.680018:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83b46197-9c3c-40cf-ad07-7480b68e6519+8:14423:x1876716462132864:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:3.0:1789776684.680401:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83b46197-9c3c-40cf-ad07-7480b68e6519+9:14423:x1876716462132864:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 386us (829us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1789776684.680409:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 2 00000100:00100000:2.0:1789776684.687339:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776684.687431:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462133120 00000100:00100000:1.0:1789776684.687441:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462133120 00000100:00100000:1.0:1789776684.687507:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 25 00000100:00100000:1.0:1789776684.687519:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83b46197-9c3c-40cf-ad07-7480b68e6519+9:14423:x1876716462133120:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1789776684.687544:0:14348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776684.687565:0:14348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030400/0x26940258de8f05b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2bb5 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.687636:0:14348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030a00/0x26940258de8f05b9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.687651:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030a00/0x26940258de8f05b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.687662:0:14348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030a00/0x26940258de8f05b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.687706:0:14348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3400/0x26940258de8f05c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.687714:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3400/0x26940258de8f05c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.687721:0:14348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3400/0x26940258de8f05c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776684.687833:0:14348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789776684.687923:0:14348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030a00/0x26940258de8f05b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.687931:0:14348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030a00/0x26940258de8f05b9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.687937:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030a00/0x26940258de8f05b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.687942:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8680030a00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776684.687946:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030a00/0x26940258de8f05b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.687954:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030a00/0x26940258de8f05b9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.687966:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c869055f500) 00010000:00010000:1.0:1789776684.687969:0:14348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776684.687973:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030a00/0x26940258de8f05b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.687990:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030a00/0x26940258de8f05b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.688016:0:14348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3400/0x26940258de8f05c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.688023:0:14348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3400/0x26940258de8f05c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.688029:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3400/0x26940258de8f05c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.688034:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86920c3400 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776684.688037:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3400/0x26940258de8f05c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.688042:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3400/0x26940258de8f05c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.688050:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c8686bff800) 00010000:00010000:1.0:1789776684.688052:0:14348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776684.688055:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3400/0x26940258de8f05c0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.688061:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3400/0x26940258de8f05c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.688101:0:14348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030400/0x26940258de8f05b2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2bb5 expref: 11 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.688121:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c869055f500) 00010000:00010000:1.0:1789776684.688123:0:14348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789776684.688126:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8680030400/0x26940258de8f05b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2bb5 expref: 11 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.688136:0:14348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8680030400, rc 0) 00000100:00100000:1.0:1789776684.688193:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83b46197-9c3c-40cf-ad07-7480b68e6519+10:14423:x1876716462133120:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 677us (864us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1789776684.688201:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 25 00000100:00100000:0.0:1789776684.692059:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776684.692420:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462133248 00000100:00100000:1.0:1789776684.692439:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462133248 00000100:00100000:1.0:1789776684.693711:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 26 00000100:00100000:1.0:1789776684.693730:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83b46197-9c3c-40cf-ad07-7480b68e6519+10:14423:x1876716462133248:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1789776684.693756:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776684.693782:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3600/0x26940258de8f05ce lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2bbc expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.693873:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3e00/0x26940258de8f05d5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.693888:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3e00/0x26940258de8f05d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.693900:0:14349:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3e00/0x26940258de8f05d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776684.693923:0:14349:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789776684.693939:0:14349:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789776684.693959:0:14349:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3e00/0x26940258de8f05d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.693985:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3600/0x26940258de8f05ce lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2bbc expref: 12 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.694014:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3e00/0x26940258de8f05d5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2bbc expref: 11 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.694023:0:14349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c8686bff900) 00010000:00010000:1.0:1789776684.694026:0:14349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789776684.694029:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86920c3e00, rc 0) 00000100:00100000:1.0:1789776684.694095:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83b46197-9c3c-40cf-ad07-7480b68e6519+11:14423:x1876716462133248:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 372us (2045us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776684.694102:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 26 00000100:00100000:0.0:1789776684.718076:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776684.718209:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462133376 00000100:00100000:1.0:1789776684.718251:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462133376 00000100:00100000:1.0:1789776684.718322:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 3 00000100:00100000:1.0:1789776684.718334:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf299f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83b46197-9c3c-40cf-ad07-7480b68e6519+11:14423:x1876716462133376:12345-192.168.202.6@tcp:37:lfs.0 00000100:00100000:1.0:1789776684.729482:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf299f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83b46197-9c3c-40cf-ad07-7480b68e6519+11:14423:x1876716462133376:12345-192.168.202.6@tcp:37:lfs.0 Request processed in 11134us (11406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776684.729500:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 3 00000100:00100000:0.0:1789776684.735294:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776684.735486:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462133632 00000100:00100000:2.0:1789776684.735508:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462133632 00000100:00100000:2.0:1789776684.735572:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4 00000100:00100000:2.0:1789776684.735583:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba39e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83b46197-9c3c-40cf-ad07-7480b68e6519+11:14423:x1876716462133632:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:2.0:1789776684.735862:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba39e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83b46197-9c3c-40cf-ad07-7480b68e6519+12:14423:x1876716462133632:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 279us (583us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1789776684.735871:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4 00010000:00010000:0.0:1789776684.756452:0:16063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776684.838451:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776684.844312:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462133760 00000100:00100000:2.0:1789776684.844335:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462133760 00000100:00100000:2.0:1789776684.844443:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 27 00000100:00100000:2.0:1789776684.844478:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+9:14429:x1876716462133760:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:2.0:1789776684.844508:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776684.844540:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f05dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2bc3 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.844740:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7a00/0x26940258de8f05e3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.844759:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7a00/0x26940258de8f05e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.844773:0:14347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7a00/0x26940258de8f05e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.844791:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8f05ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.844799:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8f05ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.844806:0:14347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8f05ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.845209:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7000/0x26940258de8f05f1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.845246:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7000/0x26940258de8f05f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.845254:0:14347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7000/0x26940258de8f05f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776684.845304:0:14347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789776684.845308:0:14347:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789776684.845357:0:14347:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7000/0x26940258de8f05f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.845372:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7a00/0x26940258de8f05e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.845379:0:14347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7a00/0x26940258de8f05e3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.845387:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7a00/0x26940258de8f05e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.845393:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc7a00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776684.845398:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7a00/0x26940258de8f05e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.845406:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7a00/0x26940258de8f05e3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.845419:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c869055f500) 00010000:00010000:2.0:1789776684.845422:0:14347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776684.845427:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7a00/0x26940258de8f05e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.845433:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7a00/0x26940258de8f05e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.845449:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8f05ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.845467:0:14347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8f05ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.845473:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8f05ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.845478:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc6c00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776684.845481:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8f05ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.845488:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8f05ea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.845496:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c869055f300) 00010000:00010000:2.0:1789776684.845499:0:14347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776684.845502:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8f05ea lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.845509:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8f05ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.845544:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f05dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2bc3 expref: 11 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.845800:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7000/0x26940258de8f05f1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2bc3 expref: 10 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.845808:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c8686bff900) 00010000:00010000:2.0:1789776684.845811:0:14347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789776684.845829:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c868afc7000, rc 0) 00000100:00100000:2.0:1789776684.846122:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+10:14429:x1876716462133760:12345-192.168.202.6@tcp:101:bash.0 Request processed in 1646us (7684us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776684.846132:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 27 00000100:00100000:3.0:1789776684.857635:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776684.857887:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462134016 00000100:00100000:1.0:1789776684.857901:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462134016 00000100:00100000:1.0:1789776684.857988:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 28 00000100:00100000:1.0:1789776684.858011:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1367cae-ee96-4b87-865d-1591bdfc1114+10:14429:x1876716462134016:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:1.0:1789776684.858042:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776684.858099:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3600/0x26940258de8f05f8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2bca expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.858617:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3400/0x26940258de8f05ff lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.858636:0:14349:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3e00/0x26940258de8f05d5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2bbc expref: 11 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.858647:0:14349:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3400/0x26940258de8f05ff lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.858840:0:14349:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3e00/0x26940258de8f05d5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2bbc expref: 11 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.858860:0:14349:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3e00/0x26940258de8f05d5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2bbc expref: 11 pid: 14349 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776684.858879:0:14349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a01df800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14349:1876716471559424:192.168.202.6@tcp:104: 00000100:00100000:1.0:1789776684.859018:0:14349:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86aeede840 going to sleep for 11 seconds 00000100:00100000:0.0:1789776684.862458:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776684.862709:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462134144 00000100:00100000:2.0:1789776684.862722:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462134144 00010000:00010000:2.0:1789776684.862781:0:14333:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3e00/0x26940258de8f05d5 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2bbc expref: 12 pid: 14349 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776684.862833:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00100000:2.0:1789776684.862844:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf29b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83b46197-9c3c-40cf-ad07-7480b68e6519+12:2357:x1876716462134144:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789776684.862868:0:14333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776684.862876:0:14333:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3e00/0x26940258de8f05d5 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2bbc expref: 12 pid: 14349 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.862893:0:14333:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3e00/0x26940258de8f05d5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2bbc expref: 12 pid: 14349 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.862925:0:14333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c8686bff900) 00010000:00010000:2.0:1789776684.862931:0:14333:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3400/0x26940258de8f05ff lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.862944:0:14333:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3400/0x26940258de8f05ff lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.862953:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3400/0x26940258de8f05ff lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.862979:0:14333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776684.863089:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf29b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83b46197-9c3c-40cf-ad07-7480b68e6519+12:2357:x1876716462134144:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 245us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776684.863099:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 10 00010000:00010000:1.0:1789776684.864736:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3e00/0x26940258de8f05d5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2bbc expref: 11 pid: 14349 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776684.864766:0:14349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a01df800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14349:1876716471559424:192.168.202.6@tcp:104: 00010000:00010000:1.0:1789776684.864797:0:14349:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3400/0x26940258de8f05ff lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.864809:0:14349:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3400/0x26940258de8f05ff lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.864838:0:14349:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3400/0x26940258de8f05ff lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.864868:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3000/0x26940258de8f0606 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.864889:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3000/0x26940258de8f0606 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.864901:0:14349:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3000/0x26940258de8f0606 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.867453:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3200/0x26940258de8f060d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.867482:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3200/0x26940258de8f060d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.867495:0:14349:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3200/0x26940258de8f060d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776684.867509:0:14349:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789776684.867547:0:14349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3400/0x26940258de8f05ff lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.867556:0:14349:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3400/0x26940258de8f05ff lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.867563:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3400/0x26940258de8f05ff lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.867570:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86920c3400 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776684.867591:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3400/0x26940258de8f05ff lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.867600:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3400/0x26940258de8f05ff lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.867616:0:14349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c8686bff900) 00010000:00010000:1.0:1789776684.867619:0:14349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776684.867624:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3400/0x26940258de8f05ff lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.867630:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3400/0x26940258de8f05ff lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789776684.867646:0:14349:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fe1cb8af reply state 00000000c6265c52 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3000/0x26940258de8f0606 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776684.867667:0:14349:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789776684.867943:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3600/0x26940258de8f05f8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2bca expref: 13 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.867962:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3200/0x26940258de8f060d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2bca expref: 12 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776684.867971:0:14349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c8686bfff00) 00010000:00010000:1.0:1789776684.867973:0:14349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1789776684.867976:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86920c3200, rc 0) 00000100:00100000:1.0:1789776684.868181:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1367cae-ee96-4b87-865d-1591bdfc1114+13:14429:x1876716462134016:12345-192.168.202.6@tcp:101:bash.0 Request processed in 10181us (10562us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1789776684.868191:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 28 00010000:00010000:2.0:1789776684.873804:0:3260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3000/0x26940258de8f0606 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.873835:0:3260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3000/0x26940258de8f0606 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.873846:0:3260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3000/0x26940258de8f0606 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.873854:0:3260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86920c3000 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776684.873862:0:3260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3000/0x26940258de8f0606 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.873874:0:3260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3000/0x26940258de8f0606 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.873901:0:3260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9c8686bff800) 00010000:00010000:2.0:1789776684.873906:0:3260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776684.873913:0:3260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3000/0x26940258de8f0606 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.873920:0:3260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3000/0x26940258de8f0606 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776684.903156:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776684.903579:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462134272 00000100:00100000:2.0:1789776684.903594:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462134272 00000100:00100000:2.0:1789776684.903744:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 29 00000100:00100000:2.0:1789776684.903758:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf29ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+12:14429:x1876716462134272:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:2.0:1789776684.903812:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776684.903841:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f061b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2bd1 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.904011:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8f0622 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.904033:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8f0622 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.904048:0:14347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8f0622 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776684.904102:0:14347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789776684.904108:0:14347:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789776684.904133:0:14347:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8f0622 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.904144:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8f0622 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.904173:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f061b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2bd1 expref: 14 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.904196:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8f0622 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2bd1 expref: 13 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776684.904205:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c8686bfff00) 00010000:00010000:2.0:1789776684.904209:0:14347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789776684.904213:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c868afc6c00, rc 0) 00000100:00100000:2.0:1789776684.904607:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf29ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+13:14429:x1876716462134272:12345-192.168.202.6@tcp:101:bash.0 Request processed in 852us (1467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776684.904615:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 29 00000100:00100000:0.0:1789776684.920150:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776684.920299:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462134528 00000100:00100000:2.0:1789776684.920313:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462134528 00000100:00100000:2.0:1789776684.920391:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5 00000100:00100000:2.0:1789776684.920404:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf29b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+13:14429:x1876716462134528:12345-192.168.202.6@tcp:35:bash.0 00000100:00100000:2.0:1789776684.920864:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf29b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+14:14429:x1876716462134528:12345-192.168.202.6@tcp:35:bash.0 Request processed in 461us (727us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1789776684.920873:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5 00000100:00100000:2.0:1789776684.949106:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789776684.949140:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf298a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471559552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789776684.949286:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776684.949429:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471559552 00000100:00100000:0.0:1789776684.949441:0:15033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471559552 00000100:00100000:0.0:1789776684.949547:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789776684.949582:0:15033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471559552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789776684.949640:0:15033:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789776684.949715:0:15033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471559552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776684.949723:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789776684.949776:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf298a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471559552:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789776684.950120:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789776685.154291:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776685.163417:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462134784 00000100:00100000:1.0:1789776685.164122:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462134784 00000100:00100000:1.0:1789776685.164366:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 30 00000100:00100000:1.0:1789776685.164381:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1367cae-ee96-4b87-865d-1591bdfc1114+14:14439:x1876716462134784:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1789776685.164416:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776685.172827:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f0629 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2bd8 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776685.172988:0:14349:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789776685.176897:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f0629 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2bd8 expref: 16 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776685.176926:0:14349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c869055f500) 00010000:00010000:3.0:1789776685.176930:0:14349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789776685.176937:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f0629 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2bd8 expref: 16 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776685.176955:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8686774200, rc 0) 00000100:00100000:3.0:1789776685.178107:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1367cae-ee96-4b87-865d-1591bdfc1114+15:14439:x1876716462134784:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 13710us (23813us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1789776685.178149:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 30 00000100:00100000:0.0:1789776685.184713:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776685.184942:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462135040 00000100:00100000:1.0:1789776685.184956:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462135040 00000100:00100000:1.0:1789776685.185683:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 6 00000100:00100000:1.0:1789776685.185701:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1367cae-ee96-4b87-865d-1591bdfc1114+15:14439:x1876716462135040:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:1.0:1789776685.186632:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1367cae-ee96-4b87-865d-1591bdfc1114+16:14439:x1876716462135040:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 931us (1929us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1789776685.186643:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 6 00000100:00100000:0.0:1789776685.264413:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776685.264861:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462135296 00000100:00100000:1.0:1789776685.264875:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462135296 00000100:00100000:1.0:1789776685.265031:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 31 00000100:00100000:1.0:1789776685.265045:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf29bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1367cae-ee96-4b87-865d-1591bdfc1114+16:14442:x1876716462135296:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1789776685.265081:0:14348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776685.265362:0:14348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3600/0x26940258de8f0637 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2bdf expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776685.265504:0:14348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3400/0x26940258de8f063e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776685.265533:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3400/0x26940258de8f063e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776685.265551:0:14348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3400/0x26940258de8f063e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776685.265591:0:14348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789776685.265864:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3600/0x26940258de8f0637 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2bdf expref: 19 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776685.265888:0:14348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3400/0x26940258de8f063e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2bdf expref: 18 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776685.265897:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c8686bfff00) 00010000:00010000:1.0:1789776685.265900:0:14348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789776685.265905:0:14348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86920c3400, rc 0) 00000100:00100000:1.0:1789776685.265987:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf29bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1367cae-ee96-4b87-865d-1591bdfc1114+18:14442:x1876716462135296:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 945us (1591us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1789776685.266009:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 31 00000100:00100000:0.0:1789776685.286890:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776685.286948:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776685.287570:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462135424 00000100:00100000:3.0:1789776685.287586:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462135424 00000100:00100000:3.0:1789776685.287667:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 32 00000100:00100000:3.0:1789776685.287681:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf299c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1367cae-ee96-4b87-865d-1591bdfc1114+18:14442:x1876716462135424:12345-192.168.202.6@tcp:54:lfs.0 00010000:00010000:3.0:1789776685.287779:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f064c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776685.287802:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f064c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776685.287816:0:14349:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f064c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776685.287852:0:14349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f064c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776685.287860:0:14349:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f064c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776685.287867:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f064c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776685.287874:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8686774200 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776685.287880:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f064c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776685.287889:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f064c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776685.287905:0:14349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c8686bfff00) 00010000:00010000:3.0:1789776685.287930:0:14349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789776685.287936:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f064c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776685.287943:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f064c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776685.288072:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf299c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1367cae-ee96-4b87-865d-1591bdfc1114+18:14442:x1876716462135424:12345-192.168.202.6@tcp:54:lfs.0 Request processed in 393us (1198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776685.288081:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 32 00000100:00100000:0.0:1789776685.291531:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776685.291672:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462135808 00000100:00100000:3.0:1789776685.291687:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462135808 00000100:00100000:3.0:1789776685.291762:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 7 00000100:00100000:3.0:1789776685.291775:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1367cae-ee96-4b87-865d-1591bdfc1114+18:14442:x1876716462135808:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:3.0:1789776685.292153:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1367cae-ee96-4b87-865d-1591bdfc1114+19:14442:x1876716462135808:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 380us (643us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1789776685.292162:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 7 00000100:00100000:1.0:1789776685.293992:0:16457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462135552 00000100:00100000:1.0:1789776685.294034:0:16457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462135552 00000100:00100000:1.0:1789776685.294126:0:16457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 0 00000100:00100000:1.0:1789776685.294138:0:16457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf29a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1367cae-ee96-4b87-865d-1591bdfc1114+19:2357:x1876716462135552:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776685.294157:0:16457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776685.294191:0:16457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3400/0x26940258de8f063e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2bdf expref: 19 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776685.294236:0:16457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c8686bfff00) 00010000:00010000:1.0:1789776685.294244:0:16457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776685.294309:0:16457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf29a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1367cae-ee96-4b87-865d-1591bdfc1114+18:2357:x1876716462135552:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 174us (7359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776685.294316:0:16457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 0 00000040:00080000:2.0:1789776685.334697:0:14381:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789776685.646113:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776685.646292:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462136064 00000100:00100000:1.0:1789776685.646309:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462136064 00000100:00100000:1.0:1789776685.646401:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 33 00000100:00100000:1.0:1789776685.646413:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf29aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1367cae-ee96-4b87-865d-1591bdfc1114+18:14473:x1876716462136064:12345-192.168.202.6@tcp:101:cat.0 00010000:00010000:1.0:1789776685.646450:0:14348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776685.646480:0:14348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3400/0x26940258de8f0653 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2be6 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776685.646876:0:14348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3600/0x26940258de8f065a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776685.646895:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3600/0x26940258de8f065a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776685.646910:0:14348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3600/0x26940258de8f065a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789776685.646925:0:14348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789776685.647126:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3400/0x26940258de8f0653 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2be6 expref: 21 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776685.647148:0:14348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3600/0x26940258de8f065a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2be6 expref: 20 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776685.647157:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c8686bfff00) 00010000:00010000:1.0:1789776685.647160:0:14348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789776685.647163:0:14348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86920c3600, rc 0) 00000100:00100000:1.0:1789776685.647336:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf29aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1367cae-ee96-4b87-865d-1591bdfc1114+20:14473:x1876716462136064:12345-192.168.202.6@tcp:101:cat.0 Request processed in 925us (1243us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1789776685.647365:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 33 00000100:00100000:0.0:1789776685.655137:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776685.655275:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462136192 00000100:00100000:2.0:1789776685.655289:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462136192 00000100:00100000:2.0:1789776685.655382:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1 00000100:00100000:2.0:1789776685.655397:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf298000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1367cae-ee96-4b87-865d-1591bdfc1114+20:2354:x1876716462136192:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789776685.655419:0:14333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776685.655455:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3600/0x26940258de8f065a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2be6 expref: 20 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776685.655482:0:14333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c8686bfff00) 00010000:00010000:2.0:1789776685.655489:0:14333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776685.655615:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf298000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1367cae-ee96-4b87-865d-1591bdfc1114+19:2354:x1876716462136192:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 220us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776685.655648:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1 00000100:00100000:0.0:1789776685.659432:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776685.662764:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462136448 00000100:00100000:3.0:1789776685.662990:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462136448 00000100:00100000:2.0:1789776685.664804:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 8 00000100:00100000:2.0:1789776685.664822:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf29a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1367cae-ee96-4b87-865d-1591bdfc1114+19:14473:x1876716462136448:12345-192.168.202.6@tcp:35:cat.0 00000100:00100000:2.0:1789776685.666014:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf29a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1367cae-ee96-4b87-865d-1591bdfc1114+20:14473:x1876716462136448:12345-192.168.202.6@tcp:35:cat.0 Request processed in 1105us (6507us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1789776685.666027:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 8 00000100:00100000:2.0:1789776685.758314:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776685.761160:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462136704 00000100:00100000:0.0:1789776685.761182:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462136704 00000100:00100000:0.0:1789776685.761329:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 34 00000100:00100000:0.0:1789776685.761344:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+20:14479:x1876716462136704:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:0.0:1789776685.761381:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776685.761414:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09400/0x26940258de8f0668 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2bed expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776685.761566:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09c00/0x26940258de8f066f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776685.761598:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09c00/0x26940258de8f066f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776685.761633:0:14347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09c00/0x26940258de8f066f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776685.761648:0:14347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789776685.761856:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09400/0x26940258de8f0668 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2bed expref: 23 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776685.761880:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09c00/0x26940258de8f066f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2bed expref: 22 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776685.761891:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c8686bfff00) 00010000:00010000:0.0:1789776685.761894:0:14347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789776685.761898:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86b9b09c00, rc 0) 00000100:00100000:0.0:1789776685.762012:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+22:14479:x1876716462136704:12345-192.168.202.6@tcp:101:dd.0 Request processed in 670us (3715us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1789776685.762021:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 34 00000100:00100000:1.0:1789776685.766182:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776685.766322:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462136960 00000100:00100000:3.0:1789776685.766338:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462136960 00000100:00100000:3.0:1789776685.766413:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 35 00000100:00100000:3.0:1789776685.766425:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1367cae-ee96-4b87-865d-1591bdfc1114+22:14479:x1876716462136960:12345-192.168.202.6@tcp:36:dd.0 00010000:00010000:3.0:1789776685.766514:0:14349:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789776685.766552:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b09c00/0x26940258de8f066f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2bed expref: 22 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776685.766579:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8f0622 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2bd1 expref: 21 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776685.766612:0:14349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c8686bfff00) 00010000:00010000:3.0:1789776685.766618:0:14349:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789776685.768034:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f067d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776685.768063:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f067d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776685.768075:0:14349:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f067d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789776685.768166:0:14349:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1789776685.768206:0:14349:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000834cdb1 reply state 0000000035cc7669 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f067d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776685.768234:0:14349:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789776685.769765:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1367cae-ee96-4b87-865d-1591bdfc1114+23:14479:x1876716462136960:12345-192.168.202.6@tcp:36:dd.0 Request processed in 3328us (3585us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1789776685.769779:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 35 00000020:00080000:3.0:1789776685.769872:0:14349:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789776685.780811:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776685.781938:0:3259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f067d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776685.781959:0:3259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f067d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776685.781968:0:3259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f067d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776685.781975:0:3259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8686774200 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776685.781981:0:3259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f067d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776685.782000:0:3259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f067d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776685.782023:0:3259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c8686bfff00) 00010000:00010000:2.0:1789776685.782026:0:3259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776685.782032:0:3259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f067d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776685.782063:0:3259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f067d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776685.892807:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776685.892954:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462137216 00000100:00100000:0.0:1789776685.892967:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462137216 00000100:00100000:0.0:1789776685.893058:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 9 00000100:00100000:0.0:1789776685.893070:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+22:14479:x1876716462137216:12345-192.168.202.6@tcp:35:dd.0 00000100:00100000:0.0:1789776685.893435:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+23:14479:x1876716462137216:12345-192.168.202.6@tcp:35:dd.0 Request processed in 366us (657us total) trans 8589934611 rc 0/0 00000100:00100000:0.0:1789776685.893444:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 9 00000100:00100000:0.0:1789776686.042127:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776686.042318:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462137344 00000100:00100000:2.0:1789776686.042332:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462137344 00000100:00100000:2.0:1789776686.042424:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 36 00000100:00100000:2.0:1789776686.042437:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf29b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+23:14493:x1876716462137344:12345-192.168.202.6@tcp:101:stat.0 00010000:00010000:2.0:1789776686.042467:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776686.042495:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7a00/0x26940258de8f0684 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2bf4 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.042582:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8f068b lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.042600:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8f068b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.042614:0:14347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8f068b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.042632:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f0692 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.042639:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f0692 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.042645:0:14347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f0692 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.042904:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6600/0x26940258de8f0699 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.042932:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6600/0x26940258de8f0699 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.042940:0:14347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6600/0x26940258de8f0699 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776686.042986:0:14347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789776686.043001:0:14347:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789776686.043054:0:14347:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6600/0x26940258de8f0699 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.043068:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6600/0x26940258de8f0699 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.043078:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8f068b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.043084:0:14347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8f068b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.043165:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8f068b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.043172:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc6c00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776686.043178:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8f068b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.043188:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8f068b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.043202:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c8686bff900) 00010000:00010000:2.0:1789776686.043212:0:14347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776686.043269:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8f068b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.043277:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8f068b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.043295:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f0692 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.043301:0:14347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f0692 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.043308:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f0692 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.043312:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc7200 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776686.043315:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f0692 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.043321:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f0692 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.043328:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9c869055f300) 00010000:00010000:2.0:1789776686.043331:0:14347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776686.043334:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f0692 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.043339:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f0692 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.043373:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7a00/0x26940258de8f0684 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2bf4 expref: 25 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.043398:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6600/0x26940258de8f0699 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2bf4 expref: 24 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.043407:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c8686bfff00) 00010000:00010000:2.0:1789776686.043409:0:14347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789776686.043412:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c868afc6600, rc 0) 00000100:00100000:2.0:1789776686.043538:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf29b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+24:14493:x1876716462137344:12345-192.168.202.6@tcp:101:stat.0 Request processed in 1103us (1425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776686.043545:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 36 00000100:00080000:3.0:1789776686.043697:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789776686.117347:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776686.117571:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462137600 00000100:00100000:1.0:1789776686.117586:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462137600 00000100:00100000:1.0:1789776686.117676:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 37 00000100:00100000:1.0:1789776686.117696:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1367cae-ee96-4b87-865d-1591bdfc1114+24:14499:x1876716462137600:12345-192.168.202.6@tcp:36:truncate.0 00010000:00010000:1.0:1789776686.117776:0:14349:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776686.117814:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6600/0x26940258de8f0699 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2bf4 expref: 24 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776686.117840:0:14349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c8686bfff00) 00010000:00010000:1.0:1789776686.117847:0:14349:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789776686.118484:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3800/0x26940258de8f06a0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776686.118504:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3800/0x26940258de8f06a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776686.118515:0:14349:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3800/0x26940258de8f06a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789776686.118583:0:14349:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:1.0:1789776686.118615:0:14349:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000ffb9ca6 reply state 00000000cb6a487e transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3800/0x26940258de8f06a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776686.118626:0:14349:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789776686.118900:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1367cae-ee96-4b87-865d-1591bdfc1114+26:14499:x1876716462137600:12345-192.168.202.6@tcp:36:truncate.0 Request processed in 1212us (1569us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1789776686.118932:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 37 00000020:00080000:1.0:1789776686.118938:0:14349:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789776686.121986:0:3260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3800/0x26940258de8f06a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.122021:0:3260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3800/0x26940258de8f06a0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.122030:0:3260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3800/0x26940258de8f06a0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.122037:0:3260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86920c3800 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776686.122043:0:3260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3800/0x26940258de8f06a0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.122053:0:3260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3800/0x26940258de8f06a0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.122076:0:3260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c8686bfff00) 00010000:00010000:2.0:1789776686.122080:0:3260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776686.122086:0:3260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3800/0x26940258de8f06a0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.122122:0:3260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3800/0x26940258de8f06a0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776686.298908:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776686.304260:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462137728 00000100:00100000:3.0:1789776686.304281:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462137728 00000100:00100000:3.0:1789776686.304442:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 38 00000100:00100000:3.0:1789776686.304455:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+25:14513:x1876716462137728:12345-192.168.202.6@tcp:101:stat.0 00010000:00010000:3.0:1789776686.304489:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776686.304515:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775400/0x26940258de8f06a7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2bfb expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.304633:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775800/0x26940258de8f06ae lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.304658:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775800/0x26940258de8f06ae lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.304680:0:14347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775800/0x26940258de8f06ae lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.304700:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f06b5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.304708:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f06b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.304715:0:14347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f06b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.304828:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8f06bc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.304836:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8f06bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.304842:0:14347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8f06bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776686.304886:0:14347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:3.0:1789776686.304890:0:14347:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789776686.304918:0:14347:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8f06bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.304942:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8f06bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.304952:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775800/0x26940258de8f06ae lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.304959:0:14347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775800/0x26940258de8f06ae lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.304967:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775800/0x26940258de8f06ae lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.304974:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8686775800 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776686.304979:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775800/0x26940258de8f06ae lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.305001:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775800/0x26940258de8f06ae lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.305016:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c8686bff900) 00010000:00010000:3.0:1789776686.305019:0:14347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776686.305024:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775800/0x26940258de8f06ae lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.305030:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775800/0x26940258de8f06ae lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.305048:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f06b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.305053:0:14347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f06b5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.305065:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f06b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.305080:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8686774200 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776686.305083:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f06b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.305095:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f06b5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.305103:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9c8682cbeb00) 00010000:00010000:3.0:1789776686.305106:0:14347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776686.305109:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f06b5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.305115:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f06b5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.305152:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775400/0x26940258de8f06a7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2bfb expref: 27 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.305166:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8f06bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2bfb expref: 26 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.305174:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c8686bfff00) 00010000:00010000:3.0:1789776686.305177:0:14347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789776686.305180:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8686775000, rc 0) 00000100:00100000:3.0:1789776686.305328:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+26:14513:x1876716462137728:12345-192.168.202.6@tcp:101:stat.0 Request processed in 875us (9346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776686.305345:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 38 00000040:00080000:2.0:1789776686.359938:0:14381:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789776686.406382:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776686.406586:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462137984 00000100:00100000:3.0:1789776686.406601:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462137984 00000100:00100000:3.0:1789776686.406753:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 39 00000100:00100000:3.0:1789776686.406765:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1367cae-ee96-4b87-865d-1591bdfc1114+26:14524:x1876716462137984:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1789776686.406795:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776686.406823:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775400/0x26940258de8f06c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2c02 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776686.406951:0:14349:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789776686.407140:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775400/0x26940258de8f06c3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c02 expref: 28 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.407161:0:14349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c869055f500) 00010000:00010000:3.0:1789776686.407164:0:14349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789776686.407171:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775400/0x26940258de8f06c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c02 expref: 28 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.407190:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8686775400, rc 0) 00000100:00100000:3.0:1789776686.407336:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1367cae-ee96-4b87-865d-1591bdfc1114+27:14524:x1876716462137984:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 573us (977us total) trans 8589934614 rc 301/301 00000100:00100000:3.0:1789776686.407345:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 39 00000100:00100000:1.0:1789776686.411610:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776686.411809:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462138240 00000100:00100000:0.0:1789776686.411825:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462138240 00000100:00100000:0.0:1789776686.411920:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00100000:0.0:1789776686.411931:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba39c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+27:14524:x1876716462138240:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:0.0:1789776686.412295:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba39c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+28:14524:x1876716462138240:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 365us (699us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1789776686.412304:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00100000:1.0:1789776686.512377:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776686.512512:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462138496 00000100:00100000:3.0:1789776686.512527:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462138496 00000100:00100000:3.0:1789776686.512619:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 40 00000100:00100000:3.0:1789776686.512633:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+28:14530:x1876716462138496:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:3.0:1789776686.512714:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776686.512747:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775400/0x26940258de8f06d1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2c09 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.512901:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f06d8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.512923:0:14347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3200/0x26940258de8f060d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2bca expref: 29 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.512932:0:14347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8f06bc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2bfb expref: 29 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.512942:0:14347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f06d8 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.512998:0:14347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8f06bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2bfb expref: 29 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.513015:0:14347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8f06bc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2bfb expref: 29 pid: 14347 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776686.513031:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c8582a73100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14347:1876716471559680:192.168.202.6@tcp:104: 00010000:00010000:3.0:1789776686.513183:0:14347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3200/0x26940258de8f060d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2bca expref: 29 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.513194:0:14347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3200/0x26940258de8f060d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2bca expref: 29 pid: 14349 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776686.513254:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c8582a73480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14347:1876716471559808:192.168.202.6@tcp:104: 00000100:00100000:3.0:1789776686.513293:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf30e900 going to sleep for 11 seconds 00000100:00100000:3.0:1789776686.521203:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c8582a73100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14347:1876716471559680:192.168.202.6@tcp:104: 00000100:00100000:3.0:1789776686.521265:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c8582a73480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14347:1876716471559808:192.168.202.6@tcp:104: 00010000:00010000:3.0:1789776686.521314:0:14347:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f06d8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776686.523205:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776686.523292:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776686.523576:0:16457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462138624 00000100:00100000:2.0:1789776686.523597:0:16457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462138624 00010000:00010000:2.0:1789776686.523661:0:16457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8f06bc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2bfb expref: 30 pid: 14347 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776686.523709:0:16457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462138752 00000100:00100000:2.0:1789776686.523712:0:16457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462138752 00010000:00010000:2.0:1789776686.523724:0:16457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3200/0x26940258de8f060d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2bca expref: 31 pid: 14349 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776686.523749:0:16457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 11 00000100:00100000:2.0:1789776686.523758:0:16457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf747c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1367cae-ee96-4b87-865d-1591bdfc1114+31:2356:x1876716462138624:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789776686.523778:0:16457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776686.523785:0:16457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8f06bc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2bfb expref: 31 pid: 14347 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.523799:0:16457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8f06bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2bfb expref: 31 pid: 14347 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.523826:0:16457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8f06bc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2bfb expref: 31 pid: 14347 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.523845:0:16457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c8686bfff00) 00010000:00010000:2.0:1789776686.523867:0:16457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f06d8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.523877:0:16457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f06d8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.523884:0:16457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776686.523946:0:16457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf747c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1367cae-ee96-4b87-865d-1591bdfc1114+30:2356:x1876716462138624:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 189us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776686.523954:0:16457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 11 00000100:00100000:2.0:1789776686.524018:0:16457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 12 00000100:00100000:2.0:1789776686.524024:0:16457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1367cae-ee96-4b87-865d-1591bdfc1114+29:2356:x1876716462138752:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789776686.524032:0:16457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776686.524036:0:16457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3200/0x26940258de8f060d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2bca expref: 29 pid: 14349 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.524047:0:16457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3200/0x26940258de8f060d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2bca expref: 29 pid: 14349 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.524060:0:16457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c3200/0x26940258de8f060d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2bca expref: 29 pid: 14349 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.524070:0:16457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c8686bfff00) 00010000:00010000:2.0:1789776686.524073:0:16457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f06d8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.524082:0:16457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f06d8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.524100:0:16457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f06d8 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.524124:0:16457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776686.524140:0:16457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1367cae-ee96-4b87-865d-1591bdfc1114+28:2356:x1876716462138752:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 116us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776686.524146:0:16457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 12 00010000:00010000:3.0:1789776686.525163:0:14347:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f06d8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.525186:0:14347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f06d8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776686.525210:0:14347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:3.0:1789776686.525438:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775400/0x26940258de8f06d1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c09 expref: 29 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.525458:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f06d8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c09 expref: 28 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.525468:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c8686bfff00) 00010000:00010000:3.0:1789776686.525471:0:14347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789776686.525474:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8686774200, rc 0) 00000100:00100000:3.0:1789776686.525535:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+28:14530:x1876716462138496:12345-192.168.202.6@tcp:101:bash.0 Request processed in 12906us (13176us total) trans 8589934616 rc 0/0 00000100:00100000:3.0:1789776686.525542:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 40 00000100:00100000:1.0:1789776686.537027:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776686.537529:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462139008 00000100:00100000:3.0:1789776686.537547:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462139008 00000100:00100000:3.0:1789776686.537660:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 41 00000100:00100000:3.0:1789776686.537682:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1367cae-ee96-4b87-865d-1591bdfc1114+28:14530:x1876716462139008:12345-192.168.202.6@tcp:36:bash.0 00010000:00010000:3.0:1789776686.538110:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775400/0x26940258de8f06e6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.538136:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775400/0x26940258de8f06e6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.538150:0:14349:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775400/0x26940258de8f06e6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789776686.538870:0:14349:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:3.0:1789776686.538922:0:14349:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dc8c736c reply state 000000005d7ff6d4 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775400/0x26940258de8f06e6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776686.538934:0:14349:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789776686.539104:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1367cae-ee96-4b87-865d-1591bdfc1114+31:14530:x1876716462139008:12345-192.168.202.6@tcp:36:bash.0 Request processed in 1430us (2090us total) trans 8589934618 rc 0/0 00000100:00100000:3.0:1789776686.539114:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 41 00000020:00080000:3.0:1789776686.539121:0:14349:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789776686.546285:0:3259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775400/0x26940258de8f06e6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.546310:0:3259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775400/0x26940258de8f06e6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.546319:0:3259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775400/0x26940258de8f06e6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.546326:0:3259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8686775400 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776686.546333:0:3259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775400/0x26940258de8f06e6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.546342:0:3259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775400/0x26940258de8f06e6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.546364:0:3259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c8686bfff00) 00010000:00010000:2.0:1789776686.546367:0:3259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776686.546373:0:3259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775400/0x26940258de8f06e6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.546379:0:3259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775400/0x26940258de8f06e6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776686.551106:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776686.557936:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462139136 00000100:00100000:3.0:1789776686.557961:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462139136 00000100:00100000:3.0:1789776686.558116:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 42 00000100:00100000:3.0:1789776686.558130:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf29b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+30:14530:x1876716462139136:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:3.0:1789776686.558178:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776686.558209:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775800/0x26940258de8f06ed lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2c10 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.558380:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775800/0x26940258de8f06ed lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c10 expref: 31 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.558399:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775800/0x26940258de8f06ed lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c10 expref: 31 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.558425:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c8686bfff00) 00010000:00010000:3.0:1789776686.558428:0:14347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789776686.558433:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8686775800, rc 0) 00000100:00100000:3.0:1789776686.558608:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf29b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+31:14530:x1876716462139136:12345-192.168.202.6@tcp:101:bash.0 Request processed in 481us (7531us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776686.558624:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 42 00000100:00100000:2.0:1789776686.581601:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776686.582044:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462139264 00000100:00100000:3.0:1789776686.582059:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462139264 00000100:00100000:3.0:1789776686.582150:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 43 00000100:00100000:3.0:1789776686.582163:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1367cae-ee96-4b87-865d-1591bdfc1114+31:14530:x1876716462139264:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:3.0:1789776686.582368:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789776686.582397:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775400/0x26940258de8f06f4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2c17 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.582512:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8f06fb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.582530:0:14349:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f06d8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c09 expref: 32 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.582568:0:14349:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8f06fb lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.582612:0:14349:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f06d8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c09 expref: 32 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.582629:0:14349:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f06d8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c09 expref: 32 pid: 14347 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776686.582834:0:14349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c8582a73480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14349:1876716471559936:192.168.202.6@tcp:104: 00000100:00100000:3.0:1789776686.583047:0:14349:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf30e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789776686.593855:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776686.594415:0:16457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462139392 00000100:00100000:2.0:1789776686.594431:0:16457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462139392 00010000:00010000:2.0:1789776686.594486:0:16457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f06d8 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c09 expref: 33 pid: 14347 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776686.594536:0:16457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 13 00000100:00100000:2.0:1789776686.594548:0:16457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1367cae-ee96-4b87-865d-1591bdfc1114+33:2356:x1876716462139392:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789776686.594568:0:16457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776686.594577:0:16457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f06d8 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c09 expref: 33 pid: 14347 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.594593:0:16457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f06d8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c09 expref: 33 pid: 14347 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.594625:0:16457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c8686bfff00) 00010000:00010000:2.0:1789776686.594632:0:16457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8f06fb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.594655:0:16457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8f06fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.594665:0:16457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8f06fb lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.594699:0:16457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776686.594789:0:16457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1367cae-ee96-4b87-865d-1591bdfc1114+33:2356:x1876716462139392:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 243us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776686.594820:0:16457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 13 00010000:00010000:3.0:1789776686.595209:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686774200/0x26940258de8f06d8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c09 expref: 32 pid: 14347 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776686.595272:0:14349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c8582a73480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14349:1876716471559936:192.168.202.6@tcp:104: 00010000:00010000:3.0:1789776686.595299:0:14349:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8f06fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.595308:0:14349:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8f06fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.595315:0:14349:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8f06fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776686.595384:0:14349:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789776686.595390:0:14349:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789776686.595419:0:14349:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8f06fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.595469:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775400/0x26940258de8f06f4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c17 expref: 32 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.595486:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8f06fb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c17 expref: 31 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.595494:0:14349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c8686bfff00) 00010000:00010000:3.0:1789776686.595497:0:14349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789776686.595500:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c8686775000, rc 0) 00000100:00100000:3.0:1789776686.595540:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1367cae-ee96-4b87-865d-1591bdfc1114+31:14530:x1876716462139264:12345-192.168.202.6@tcp:101:bash.0 Request processed in 13381us (13954us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776686.595549:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 43 00000100:00100000:3.0:1789776686.606473:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776686.606733:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462139648 00000100:00100000:1.0:1789776686.606748:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462139648 00000100:00100000:1.0:1789776686.606839:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 2 00000100:00100000:1.0:1789776686.606855:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1367cae-ee96-4b87-865d-1591bdfc1114+31:14530:x1876716462139648:12345-192.168.202.6@tcp:103:bash.0 00010000:00010000:1.0:1789776686.606881:0:14334:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789776686.606920:0:14334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775000/0x26940258de8f06fb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c17 expref: 31 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776686.606955:0:14334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8686775800/0x26940258de8f06ed lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c10 expref: 30 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776686.606968:0:14334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c8686bfff00) 00010000:00010000:1.0:1789776686.606983:0:14334:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776686.607085:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1367cae-ee96-4b87-865d-1591bdfc1114+29:14530:x1876716462139648:12345-192.168.202.6@tcp:103:bash.0 Request processed in 234us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776686.607104:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 2 00000100:00100000:1.0:1789776686.610887:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776686.611031:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462139776 00000100:00100000:3.0:1789776686.611047:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462139776 00000100:00100000:3.0:1789776686.611121:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 44 00000100:00100000:3.0:1789776686.611133:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86a01dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+29:14530:x1876716462139776:12345-192.168.202.6@tcp:58:bash.0 00010000:00010000:3.0:1789776686.611333:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8f0702 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.611357:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8f0702 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776686.611372:0:14347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8f0702 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789776686.612367:0:14347:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789776686.612567:0:14347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1789776686.612687:0:14347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1789776686.612844:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86a01dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+29:14530:x1876716462139776:12345-192.168.202.6@tcp:58:bash.0 Request processed in 1708us (1969us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776686.612856:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 44 00000100:00100000:2.0:1789776686.617451:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776686.617572:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462139904 00000100:00100000:3.0:1789776686.617587:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462139904 00000100:00100000:2.0:1789776686.621248:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 45 00000100:00100000:2.0:1789776686.621281:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1367cae-ee96-4b87-865d-1591bdfc1114+29:14530:x1876716462139904:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:2.0:1789776686.621314:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776686.621347:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6000/0x26940258de8f0709 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2c1e expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.621432:0:14349:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8f0702 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.621446:0:14349:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6000/0x26940258de8f0709 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c1e expref: 30 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.621473:0:14349:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8f0702 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.621488:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6000/0x26940258de8f0709 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c1e expref: 30 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.621507:0:14349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:2.0:1789776686.621510:0:14349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789776686.621514:0:14349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6000/0x26940258de8f0709 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c1e expref: 30 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776686.621522:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c868afc6000, rc 0) 00000100:00100000:2.0:1789776686.621696:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1367cae-ee96-4b87-865d-1591bdfc1114+30:14530:x1876716462139904:12345-192.168.202.6@tcp:101:bash.0 Request processed in 432us (4259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776686.621723:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 45 00010000:00010000:2.0:1789776686.806247:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776686.999241:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a01ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471560448:0@lo:400:kworker.0 00000100:00100000:3.0:1789776686.999359:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776686.999538:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a01dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:3273:1876716471560192:0@lo:400:kworker.0 00000100:00100000:2.0:1789776686.999591:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776686.999642:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c8582a73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471560064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789776686.999672:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776686.999701:0:3273:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789776686.999707:0:3273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86a01dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471560320:0@lo:400:kworker.0 00000100:00100000:2.0:1789776686.999732:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776686.999792:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471560448 00000100:00100000:2.0:1789776686.999801:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471560448 00000100:00100000:2.0:1789776686.999874:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471560320 00000100:00100000:2.0:1789776686.999877:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471560320 00000100:00100000:2.0:1789776686.999908:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789776686.999920:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471560448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776687.002142:0:3274:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789776687.002182:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3274:1876716471560704:0@lo:400:kworker.0 00000100:00100000:0.0:1789776687.002287:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776687.002355:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471560064 00000100:00100000:0.0:1789776687.002364:0:15033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471560064 00000100:00100000:0.0:1789776687.002422:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789776687.002443:0:15033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3273:x1876716471560064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789776687.002495:0:15033:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789776687.002544:0:15033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3273:x1876716471560064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (2870us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776687.002566:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789776687.002622:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471560704 00000100:00100000:0.0:1789776687.002626:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471560704 00000100:00100000:0.0:1789776687.002745:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789776687.002757:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1876716471560704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789776687.002768:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a01ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471560448:0@lo:400:kworker.0 00000100:00100000:3.0:1789776687.002860:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789776687.002868:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3275:1876716471560576:0@lo:400:kworker.0 00000100:00100000:1.0:1789776687.002872:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789776687.002884:0:15032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471560320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776687.010431:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471560448:12345-0@lo:400:kworker.0 Request processed in 10493us (11052us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776687.010432:0:3274:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3274:1876716471560832:0@lo:400:kworker.0 00000100:00100000:2.0:1789776687.010454:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789776687.010553:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471560192 00000100:00100000:2.0:1789776687.010565:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471560192 00000100:00100000:0.0:1789776687.010597:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776687.010657:0:14347:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789776687.010813:0:14347:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1789776687.010964:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1876716471560704:12345-0@lo:400:kworker.0 Request processed in 8210us (8675us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776687.011011:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789776687.011046:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789776687.011058:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+19:3273:x1876716471560192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776687.011077:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3274:1876716471560704:0@lo:400:kworker.0 00000100:00100000:0.0:1789776687.011106:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471560832 00000100:00100000:0.0:1789776687.011109:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471560832 00000100:00100000:2.0:1789776687.011139:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8197902-2e0a-4444-a5f7-ce5e9c7a9545+19:3273:x1876716471560192:12345-0@lo:400:kworker.0 Request processed in 82us (11545us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776687.011140:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789776687.011150:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1876716471560832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789776687.011152:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789776687.011202:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1876716471560832:12345-0@lo:400:kworker.0 Request processed in 53us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776687.011209:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1789776687.011246:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789776687.011260:0:3274:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3274:1876716471560832:0@lo:400:kworker.0 00000100:00080000:2.0:1789776687.011262:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789776687.011269:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789776687.011588:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a01dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8197902-2e0a-4444-a5f7-ce5e9c7a9545:3273:1876716471560192:0@lo:400:kworker.0 00000100:00100000:2.0:1789776687.011618:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c8582a73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471560064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789776687.014360:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789776687.014409:0:15032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3273:x1876716471560320:12345-0@lo:400:kworker.0 Request processed in 11523us (14670us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776687.014411:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471560576 00000100:00100000:0.0:1789776687.014423:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471560576 00000100:00100000:2.0:1789776687.014428:0:3273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86a01dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3273:1876716471560320:0@lo:400:kworker.0 00000100:00100000:0.0:1789776687.014505:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789776687.014518:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1876716471560576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789776687.014608:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1876716471560576:12345-0@lo:400:kworker.0 Request processed in 93us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776687.014616:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789776687.014996:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3275:1876716471560576:0@lo:400:kworker.0 00000100:00100000:1.0:1789776687.015095:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000040:00080000:2.0:1789776687.381013:0:14381:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789776687.381027:0:14381:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789776687.381081:0:14381:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789776687.381089:0:14381:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789776687.381333:0:14381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86af5dea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14381:1876716471560960:192.168.202.6@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789776687.381487:0:14381:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf2c9180 going to sleep for 11 seconds 00000100:00100000:3.0:1789776687.393768:0:14381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86af5dea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14381:1876716471560960:192.168.202.6@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789776687.394351:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776687.394403:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776687.394443:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776687.394483:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776687.394508:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776687.394539:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776687.394573:0:15635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462140160 00000100:00100000:1.0:1789776687.394583:0:15635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462140160 00000100:00100000:1.0:1789776687.394656:0:15635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462140672 00000100:00100000:1.0:1789776687.394659:0:15635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462140672 00000100:00100000:1.0:1789776687.394677:0:15635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462140288 00000100:00100000:1.0:1789776687.394679:0:15635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462140288 00000100:00100000:1.0:1789776687.394693:0:15635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462140544 00000100:00100000:1.0:1789776687.394696:0:15635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462140544 00000100:00100000:1.0:1789776687.394714:0:15635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 20 00000100:00100000:1.0:1789776687.394724:0:15635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1367cae-ee96-4b87-865d-1591bdfc1114+5:2356:x1876716462140160:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1789776687.394826:0:15635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1367cae-ee96-4b87-865d-1591bdfc1114+5:2356:x1876716462140160:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 103us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776687.394835:0:15635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 20 00000100:00100000:1.0:1789776687.394854:0:15635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 21 00000100:00100000:1.0:1789776687.394860:0:15635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83b46197-9c3c-40cf-ad07-7480b68e6519+5:2356:x1876716462140672:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1789776687.394888:0:15635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83b46197-9c3c-40cf-ad07-7480b68e6519+5:2356:x1876716462140672:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 28us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776687.394915:0:15635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 21 00000100:00100000:1.0:1789776687.394927:0:15635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 22 00000100:00100000:1.0:1789776687.394933:0:15635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1367cae-ee96-4b87-865d-1591bdfc1114+5:2357:x1876716462140288:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1789776687.394960:0:15635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1367cae-ee96-4b87-865d-1591bdfc1114+5:2357:x1876716462140288:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 27us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776687.394967:0:15635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 22 00000100:00100000:1.0:1789776687.394977:0:15635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 23 00000100:00100000:1.0:1789776687.394995:0:15635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83b46197-9c3c-40cf-ad07-7480b68e6519+5:2357:x1876716462140544:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1789776687.395019:0:15635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83b46197-9c3c-40cf-ad07-7480b68e6519+5:2357:x1876716462140544:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 25us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776687.395025:0:15635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 23 00000100:00100000:3.0:1789776687.395557:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462140416 00000100:00100000:3.0:1789776687.395564:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462140416 00000100:00100000:3.0:1789776687.395622:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 30 00000100:00100000:3.0:1789776687.395640:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83b46197-9c3c-40cf-ad07-7480b68e6519+11:2356:x1876716462140416:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1789776687.395695:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83b46197-9c3c-40cf-ad07-7480b68e6519+11:2356:x1876716462140416:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 66us (1251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776687.395703:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 30 00000100:00080000:2.0:1789776687.396069:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789776687.396095:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789776687.396099:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789776687.396256:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776687.396347:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462140032 00000100:00100000:0.0:1789776687.396354:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462140032 00000100:00100000:0.0:1789776687.396411:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 121 00000100:00100000:0.0:1789776687.396419:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86ba883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08f86ba3-73a9-4ec6-813b-6c6b819447b1+13:2357:x1876716462140032:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1789776687.396467:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86ba883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08f86ba3-73a9-4ec6-813b-6c6b819447b1+13:2357:x1876716462140032:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 49us (2062us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776687.396474:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 121 00000100:00100000:2.0:1789776687.398400:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462140800 00000100:00100000:2.0:1789776687.398419:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462140800 00000100:00100000:2.0:1789776687.398498:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 0 00000100:00100000:2.0:1789776687.398510:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a1367cae-ee96-4b87-865d-1591bdfc1114+30:14531:x1876716462140800:12345-192.168.202.6@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789776687.398964:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a1367cae-ee96-4b87-865d-1591bdfc1114+30:14531:x1876716462140800:12345-192.168.202.6@tcp:900:lhsmtool_posix.0 Request processed in 455us (2750us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776687.398974:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 0 00000100:00100000:3.0:1789776687.406566:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776687.406743:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462140928 00000100:00100000:2.0:1789776687.406759:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462140928 00000100:00100000:2.0:1789776687.406854:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 46 00000100:00100000:2.0:1789776687.406869:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1367cae-ee96-4b87-865d-1591bdfc1114+30:14531:x1876716462140928:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789776687.406920:0:14349:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789776687.407138:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1367cae-ee96-4b87-865d-1591bdfc1114+30:14531:x1876716462140928:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 Request processed in 271us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776687.407147:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 46 00000100:00100000:0.0:1789776687.419386:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776687.419713:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462141056 00000100:00100000:3.0:1789776687.419728:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462141056 00000100:00100000:3.0:1789776687.419810:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 47 00000100:00100000:3.0:1789776687.419833:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf29a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+30:14531:x1876716462141056:12345-192.168.202.6@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789776687.419945:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678200/0x26940258de8f0710 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776687.419968:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678200/0x26940258de8f0710 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776687.419996:0:14347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678200/0x26940258de8f0710 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776687.423140:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8f0717 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776687.423169:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8f0717 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776687.423183:0:14347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8f0717 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776687.423233:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679a00/0x26940258de8f071e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776687.423243:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679a00/0x26940258de8f071e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776687.423250:0:14347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679a00/0x26940258de8f071e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789776687.423301:0:14347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789776687.423305:0:14347:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789776687.423325:0:14347:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679a00/0x26940258de8f071e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776687.423358:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678200/0x26940258de8f0710 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776687.423364:0:14347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678200/0x26940258de8f0710 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776687.423371:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678200/0x26940258de8f0710 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776687.423377:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681678200 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776687.423382:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678200/0x26940258de8f0710 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776687.423389:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678200/0x26940258de8f0710 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776687.423402:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c869055f400) 00010000:00010000:3.0:1789776687.423405:0:14347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776687.423409:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678200/0x26940258de8f0710 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776687.423416:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678200/0x26940258de8f0710 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776687.423432:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8f0717 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776687.423438:0:14347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8f0717 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776687.423444:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8f0717 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776687.423465:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681678800 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776687.423469:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8f0717 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776687.423476:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8f0717 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776687.423483:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9c8682cbef00) 00010000:00010000:3.0:1789776687.423486:0:14347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776687.423488:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8f0717 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776687.423494:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8f0717 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776687.423510:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679a00/0x26940258de8f071e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776687.423516:0:14347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679a00/0x26940258de8f071e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776687.423522:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679a00/0x26940258de8f071e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776687.423527:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681679a00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776687.423530:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679a00/0x26940258de8f071e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776687.423536:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679a00/0x26940258de8f071e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776687.423554:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:3.0:1789776687.423556:0:14347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776687.423559:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679a00/0x26940258de8f071e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776687.423564:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679a00/0x26940258de8f071e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776687.423736:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf29a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+30:14531:x1876716462141056:12345-192.168.202.6@tcp:34:lhsmtool_posix.0 Request processed in 3902us (4361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776687.423747:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 47 00000100:00100000:1.0:1789776687.434726:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776687.434904:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462141312 00000100:00100000:2.0:1789776687.434919:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462141312 00000100:00100000:2.0:1789776687.435727:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 48 00000100:00100000:2.0:1789776687.435742:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1367cae-ee96-4b87-865d-1591bdfc1114+30:14531:x1876716462141312:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789776687.435774:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776687.435805:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7c00/0x26940258de8f0725 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2c25 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.436011:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7800/0x26940258de8f072c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.436032:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7800/0x26940258de8f072c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.436049:0:14349:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7800/0x26940258de8f072c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776687.436063:0:14349:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789776687.436498:0:14349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7800/0x26940258de8f072c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.436530:0:14349:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7800/0x26940258de8f072c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.436540:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7800/0x26940258de8f072c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.436547:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc7800 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776687.436576:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7800/0x26940258de8f072c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.436584:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7800/0x26940258de8f072c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.436601:0:14349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:2.0:1789776687.436605:0:14349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789776687.436610:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7800/0x26940258de8f072c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.436617:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7800/0x26940258de8f072c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.436681:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7c00/0x26940258de8f0725 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c25 expref: 32 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.436695:0:14349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c869055f400) 00010000:00010000:2.0:1789776687.436697:0:14349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789776687.436812:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7c00/0x26940258de8f0725 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c25 expref: 32 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.436888:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c868afc7c00, rc 0) 00000100:00100000:2.0:1789776687.437035:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1367cae-ee96-4b87-865d-1591bdfc1114+31:14531:x1876716462141312:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 1294us (2323us total) trans 8589934619 rc 301/301 00000100:00100000:2.0:1789776687.437045:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 48 00000100:00100000:2.0:1789776687.445806:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776687.445903:0:16571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462141440 00000100:00100000:1.0:1789776687.445917:0:16571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462141440 00000100:00100000:1.0:1789776687.445991:0:16571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 49 00000100:00100000:1.0:1789776687.446003:0:16571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1367cae-ee96-4b87-865d-1591bdfc1114+31:14531:x1876716462141440:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789776687.446082:0:16571:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789776687.446273:0:16571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1367cae-ee96-4b87-865d-1591bdfc1114+31:14531:x1876716462141440:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 Request processed in 269us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776687.446280:0:16571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 49 00000100:00100000:0.0:1789776687.470942:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776687.471132:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462141696 00000100:00100000:2.0:1789776687.471147:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462141696 00000100:00100000:2.0:1789776687.471291:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 50 00000100:00100000:2.0:1789776687.471322:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1367cae-ee96-4b87-865d-1591bdfc1114+31:14531:x1876716462141696:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789776687.471350:0:14348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776687.471378:0:14348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7c00/0x26940258de8f073a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2c2c expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789776687.472322:0:14348:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:2.0:1789776687.472334:0:14348:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:2.0:1789776687.472399:0:14348:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1789776687.472738:0:14348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7800/0x26940258de8f0741 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.472758:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7800/0x26940258de8f0741 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.472772:0:14348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7800/0x26940258de8f0741 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.472854:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7c00/0x26940258de8f073a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c2c expref: 34 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.472876:0:14348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7800/0x26940258de8f0741 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c2c expref: 33 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.472886:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c869055f300) 00010000:00010000:2.0:1789776687.472890:0:14348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789776687.472894:0:14348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c868afc7800, rc 0) 00000100:00100000:2.0:1789776687.473011:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1367cae-ee96-4b87-865d-1591bdfc1114+33:14531:x1876716462141696:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 1691us (2086us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1789776687.473022:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 50 00000100:00100000:3.0:1789776687.477969:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776687.478099:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462141952 00000100:00100000:1.0:1789776687.478113:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462141952 00000100:00100000:1.0:1789776687.478204:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 51 00000100:00100000:1.0:1789776687.478244:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+33:14531:x1876716462141952:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789776687.478357:0:14347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776687.478399:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7800/0x26940258de8f0741 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c2c expref: 33 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776687.478426:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c869055f300) 00010000:00010000:1.0:1789776687.478440:0:14347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789776687.478479:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2400/0x26940258de8f074f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776687.478497:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2400/0x26940258de8f074f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776687.478509:0:14347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2400/0x26940258de8f074f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776687.478693:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2a00/0x26940258de8f0756 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x890ebe1d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776687.478720:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2a00/0x26940258de8f0756 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x890ebe1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776687.478734:0:14347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2a00/0x26940258de8f0756 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x890ebe1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776687.478830:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2400/0x26940258de8f074f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776687.478837:0:14347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2400/0x26940258de8f074f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776687.478845:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2400/0x26940258de8f074f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776687.478880:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86920c2400 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776687.478885:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2400/0x26940258de8f074f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776687.478893:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2400/0x26940258de8f074f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776687.478907:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c8686bff900) 00010000:00010000:1.0:1789776687.478911:0:14347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776687.478916:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2400/0x26940258de8f074f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776687.478921:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2400/0x26940258de8f074f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776687.478936:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2a00/0x26940258de8f0756 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x890ebe1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776687.478941:0:14347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2a00/0x26940258de8f0756 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x890ebe1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776687.478947:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2a00/0x26940258de8f0756 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x890ebe1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776687.478952:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86920c2a00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:1.0:1789776687.478954:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2a00/0x26940258de8f0756 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x890ebe1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776687.478960:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2a00/0x26940258de8f0756 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x890ebe1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776687.478990:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x890ebe1d (ffff9c8686bfff00) 00010000:00010000:1.0:1789776687.478992:0:14347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789776687.478996:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2a00/0x26940258de8f0756 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x890ebe1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776687.479001:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2a00/0x26940258de8f0756 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x890ebe1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776687.484680:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+32:14531:x1876716462141952:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 Request processed in 6450us (6710us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789776687.484697:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 51 00000100:00100000:3.0:1789776687.488402:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776687.488536:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462142080 00000100:00100000:2.0:1789776687.488559:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462142080 00000100:00100000:2.0:1789776687.488647:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 52 00000100:00100000:2.0:1789776687.488661:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1367cae-ee96-4b87-865d-1591bdfc1114+32:14531:x1876716462142080:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789776687.488691:0:14348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776687.488723:0:14348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7400/0x26940258de8f075d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2c33 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.488772:0:14348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8f0764 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.488789:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8f0764 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.488803:0:14348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8f0764 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.488947:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7400/0x26940258de8f075d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c33 expref: 34 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.488967:0:14348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6a00/0x26940258de8f0764 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c33 expref: 33 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.488988:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c869055fb00) 00010000:00010000:2.0:1789776687.488992:0:14348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789776687.488997:0:14348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c868afc6a00, rc 0) 00000100:00100000:2.0:1789776687.489088:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1367cae-ee96-4b87-865d-1591bdfc1114+33:14531:x1876716462142080:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 430us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776687.489096:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 52 00000100:00100000:0.0:1789776687.504171:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776687.505827:0:16571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462142336 00000100:00100000:1.0:1789776687.505848:0:16571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462142336 00000100:00100000:1.0:1789776687.506008:0:16571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 53 00000100:00100000:1.0:1789776687.506029:0:16571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf298700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1367cae-ee96-4b87-865d-1591bdfc1114+33:14531:x1876716462142336:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789776687.506151:0:16571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2a00/0x26940258de8f076b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776687.506176:0:16571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2a00/0x26940258de8f076b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776687.506190:0:16571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2a00/0x26940258de8f076b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16571 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789776687.506838:0:16571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1789776687.506854:0:16571:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 440286636633ns, next at 441286632827ns, rc = 0 00000004:00010000:1.0:1789776687.507001:0:16571:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000051819659 reply state 00000000fd3ef93e transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2a00/0x26940258de8f076b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16571 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776687.507039:0:16571:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789776687.507200:0:16571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf298700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1367cae-ee96-4b87-865d-1591bdfc1114+35:14531:x1876716462142336:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 Request processed in 1179us (3043us total) trans 8589934621 rc 0/0 00000100:00100000:1.0:1789776687.507210:0:16571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 53 00000100:00100000:2.0:1789776687.516406:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00010000:0.0:1789776687.516505:0:3260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2a00/0x26940258de8f076b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776687.516522:0:3260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2a00/0x26940258de8f076b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776687.516531:0:3260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2a00/0x26940258de8f076b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776687.516538:0:3260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86920c2a00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776687.516545:0:3260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2a00/0x26940258de8f076b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776687.516567:0:3260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2a00/0x26940258de8f076b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776687.516589:0:3260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c869055fb00) 00010000:00010000:0.0:1789776687.516593:0:3260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789776687.516599:0:3260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2a00/0x26940258de8f076b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776687.516606:0:3260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2a00/0x26940258de8f076b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16571 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776687.516924:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462142464 00000100:00100000:1.0:1789776687.516938:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462142464 00000100:00100000:1.0:1789776687.517023:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 54 00000100:00100000:1.0:1789776687.517038:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1367cae-ee96-4b87-865d-1591bdfc1114+34:14531:x1876716462142464:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789776687.517071:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776687.517094:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2400/0x26940258de8f0772 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2c3a expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776687.517183:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2400/0x26940258de8f0772 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c3a expref: 35 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776687.517199:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2400/0x26940258de8f0772 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c3a expref: 35 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776687.517250:0:14349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c869055fb00) 00010000:00010000:1.0:1789776687.517254:0:14349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789776687.517259:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86920c2400, rc 0) 00000100:00100000:2.0:1789776687.517399:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1367cae-ee96-4b87-865d-1591bdfc1114+35:14531:x1876716462142464:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 363us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776687.517409:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 54 00000100:00100000:2.0:1789776687.522354:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776687.525047:0:15635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462142592 00000100:00100000:1.0:1789776687.525072:0:15635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462142592 00000100:00100000:1.0:1789776687.525188:0:15635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 12 00000100:00100000:1.0:1789776687.525203:0:15635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1367cae-ee96-4b87-865d-1591bdfc1114+5:2357:x1876716462142592:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789776687.526174:0:15635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1367cae-ee96-4b87-865d-1591bdfc1114+6:2357:x1876716462142592:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 Request processed in 965us (3829us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789776687.526188:0:15635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 12 00000100:00100000:0.0:1789776687.531838:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776687.532556:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462142848 00000100:00100000:2.0:1789776687.532571:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462142848 00000100:00100000:2.0:1789776687.532657:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 11 00000100:00100000:2.0:1789776687.532669:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf29b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+35:14531:x1876716462142848:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789776687.533034:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf29b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+36:14531:x1876716462142848:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 Request processed in 366us (1209us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1789776687.533044:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 11 00000100:00100000:2.0:1789776687.537398:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776687.537514:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462143104 00000100:00100000:3.0:1789776687.537531:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462143104 00000100:00100000:3.0:1789776687.537625:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 55 00000100:00100000:3.0:1789776687.537652:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+36:14531:x1876716462143104:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789776687.537885:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+36:14531:x1876716462143104:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 235us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776687.537895:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 55 00000100:00100000:3.0:1789776687.545678:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776687.546135:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462143232 00000100:00100000:2.0:1789776687.546149:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462143232 00000100:00100000:2.0:1789776687.546288:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 56 00000100:00100000:2.0:1789776687.546301:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1367cae-ee96-4b87-865d-1591bdfc1114+36:14531:x1876716462143232:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789776687.546333:0:14348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789776687.546369:0:14348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8f0779 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2c41 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.546484:0:14348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f0780 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.546505:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f0780 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.546519:0:14348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f0780 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789776687.546598:0:14348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789776687.546624:0:14348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f0780 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.546826:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6c00/0x26940258de8f0779 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c41 expref: 38 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.546851:0:14348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f0780 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c41 expref: 37 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.546862:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c869055fb00) 00010000:00010000:2.0:1789776687.546865:0:14348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789776687.546870:0:14348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c868afc7200, rc 0) 00000100:00100000:2.0:1789776687.546989:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1367cae-ee96-4b87-865d-1591bdfc1114+37:14531:x1876716462143232:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 680us (1325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776687.546999:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 56 00000100:00100000:0.0:1789776687.560390:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776687.562190:0:15032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462143360 00000100:00100000:1.0:1789776687.562299:0:15032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462143360 00000100:00100000:1.0:1789776687.562411:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 13 00000100:00100000:1.0:1789776687.562428:0:15032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf29a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1367cae-ee96-4b87-865d-1591bdfc1114+6:2356:x1876716462143360:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789776687.562461:0:15032:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776687.562524:0:15032:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009add1b31/0x26940258de8f0787 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2c48 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789776687.562571:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aadd330, blocks: 0x1 00010000:00010000:1.0:1789776687.562605:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1789776687.562612:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776687.562637:0:15032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009add1b31/0x26940258de8f0787 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c48 expref: 7 pid: 15032 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776687.563131:0:15032:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009add1b31/0x26940258de8f0787 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c48 expref: 7 pid: 15032 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776687.563157:0:15032:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86920c2e00, rc 0) 00000100:00100000:1.0:1789776687.563294:0:15032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf29a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1367cae-ee96-4b87-865d-1591bdfc1114+7:2356:x1876716462143360:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 870us (2921us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776687.563303:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 13 00000100:00100000:3.0:1789776687.572679:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776687.576152:0:16571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462143616 00000100:00100000:1.0:1789776687.576180:0:16571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462143616 00000100:00100000:1.0:1789776687.576352:0:16571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 57 00000100:00100000:1.0:1789776687.576365:0:16571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1367cae-ee96-4b87-865d-1591bdfc1114+37:14531:x1876716462143616:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789776687.576539:0:16571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1367cae-ee96-4b87-865d-1591bdfc1114+37:14531:x1876716462143616:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 176us (3875us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776687.576568:0:16571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 57 00000100:00100000:0.0:1789776687.584679:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776687.584868:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462143744 00000100:00100000:2.0:1789776687.584889:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462143744 00000100:00100000:2.0:1789776687.584991:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 58 00000100:00100000:2.0:1789776687.585002:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1367cae-ee96-4b87-865d-1591bdfc1114+37:14531:x1876716462143744:12345-192.168.202.6@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789776687.749960:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934615 is committed 00000001:00080000:0.0:1789776687.750005:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934621 is committed 00000004:00080000:0.0:1789776687.750015:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1789776687.750056:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:0.0:1789776687.750065:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000001:00080000:0.0:1789776687.750094:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:3.0:1789776687.750717:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1367cae-ee96-4b87-865d-1591bdfc1114+13:14531:x1876716462143744:12345-192.168.202.6@tcp:44:lhsmtool_posix.0 Request processed in 165706us (166045us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776687.750734:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 58 00000100:00100000:3.0:1789776687.751668:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471561088:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789776687.751756:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789776687.752005:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471561088 00000100:00100000:2.0:1789776687.752017:0:15031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471561088 00000100:00100000:2.0:1789776687.752082:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789776687.752094:0:15031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471561088:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789776687.752354:0:15031:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789776687.752358:0:15031:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1789776687.752368:0:15031:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789776687.752370:0:15031:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789776688 -> 1789776688 00002000:00010000:2.0:1789776687.752373:0:15031:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789776687.752694:0:15031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3275:x1876716471561088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 600us (936us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1789776687.752702:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:3.0:1789776687.752778:0:3275:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c86babc1880/2, rc 0, transno 8589934595 00000100:00100000:3.0:1789776687.752786:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471561088:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789776687.756516:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776687.756656:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462143872 00000100:00100000:2.0:1789776687.756672:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462143872 00000100:00100000:2.0:1789776687.756753:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 15 00000100:00100000:2.0:1789776687.756768:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf299180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+7:2356:x1876716462143872:12345-192.168.202.6@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789776687.756930:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf299180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+7:2356:x1876716462143872:12345-192.168.202.6@tcp:16:lhsmtool_posix.0 Request processed in 166us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776687.756938:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 15 00000100:00100000:2.0:1789776687.760162:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776687.760411:0:16571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462144128 00000100:00100000:1.0:1789776687.760425:0:16571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462144128 00000100:00100000:1.0:1789776687.760497:0:16571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 59 00000100:00100000:1.0:1789776687.760509:0:16571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86af5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1367cae-ee96-4b87-865d-1591bdfc1114+13:14531:x1876716462144128:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789776687.760585:0:16571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776687.760625:0:16571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f0780 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c41 expref: 13 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776687.760645:0:16571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c869055fb00) 00010000:00010000:1.0:1789776687.760650:0:16571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789776687.760685:0:16571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2600/0x26940258de8f078e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776687.760699:0:16571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2600/0x26940258de8f078e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776687.760707:0:16571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2600/0x26940258de8f078e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16571 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789776687.761025:0:16571:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001bf87e78 reply state 00000000f993f7b6 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2600/0x26940258de8f078e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16571 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776687.761037:0:16571:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789776687.761430:0:16571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86af5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1367cae-ee96-4b87-865d-1591bdfc1114+14:14531:x1876716462144128:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 Request processed in 921us (1286us total) trans 8589934623 rc 0/0 00000100:00100000:1.0:1789776687.761441:0:16571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 59 00000100:00100000:0.0:1789776687.770702:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776687.770821:0:15635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462144256 00000100:00100000:1.0:1789776687.770856:0:15635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462144256 00000100:00100000:1.0:1789776687.770939:0:15635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 16 00000100:00100000:1.0:1789776687.770951:0:15635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf299f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1367cae-ee96-4b87-865d-1591bdfc1114+7:14531:x1876716462144256:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789776687.770990:0:15635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776687.771017:0:15635:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4441ecc/0x26940258de8f0795 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2c4f expref: -99 pid: 15635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776687.771065:0:15635:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009add1b31/0x26940258de8f0787 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c48 expref: 8 pid: 15032 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776687.771078:0:15635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776687.771083:0:15635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776687.771089:0:15635:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4441ecc/0x26940258de8f0795 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c4f expref: 8 pid: 15635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776687.771144:0:15635:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009add1b31/0x26940258de8f0787 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c48 expref: 8 pid: 15032 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776687.771162:0:15635:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009add1b31/0x26940258de8f0787 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c48 expref: 8 pid: 15032 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776687.771180:0:15635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86babc0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15635:1876716471561216:192.168.202.6@tcp:104: 00000100:00100000:1.0:1789776687.771346:0:15635:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86987b5c00 going to sleep for 11 seconds 00010000:00010000:2.0:1789776687.771432:0:3259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2600/0x26940258de8f078e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.771443:0:3259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2600/0x26940258de8f078e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.771451:0:3259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2600/0x26940258de8f078e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.771458:0:3259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86920c2600 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776687.771465:0:3259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2600/0x26940258de8f078e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.771474:0:3259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2600/0x26940258de8f078e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.771510:0:3259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c869055fb00) 00010000:00010000:2.0:1789776687.771513:0:3259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776687.771519:0:3259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2600/0x26940258de8f078e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.771526:0:3259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2600/0x26940258de8f078e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16571 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776687.775426:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776687.775586:0:16457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462144384 00000100:00100000:2.0:1789776687.775600:0:16457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462144384 00010000:00010000:2.0:1789776687.775664:0:16457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009add1b31/0x26940258de8f0787 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c48 expref: 9 pid: 15032 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776687.775705:0:16457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 14 00000100:00100000:2.0:1789776687.775716:0:16457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf7bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1367cae-ee96-4b87-865d-1591bdfc1114+9:2357:x1876716462144384:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789776687.775737:0:16457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789776687.775770:0:16457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009add1b31/0x26940258de8f0787 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c48 expref: 9 pid: 15032 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.775789:0:16457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009add1b31/0x26940258de8f0787 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c48 expref: 9 pid: 15032 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.775825:0:16457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776687.775831:0:16457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789776687.775841:0:16457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a4441ecc/0x26940258de8f0795 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c4f expref: 9 pid: 15635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.775870:0:16457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4441ecc/0x26940258de8f0795 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c4f expref: 9 pid: 15635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.775922:0:16457:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a4441ecc/0x26940258de8f0795 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c4f expref: 9 pid: 15635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776687.775941:0:16457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86af5dea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:16457:1876716471561344:192.168.202.6@tcp:105: 00010000:00010000:1.0:1789776687.776753:0:15635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009add1b31/0x26940258de8f0787 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c48 expref: 9 pid: 15032 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776687.776796:0:15635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86babc0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15635:1876716471561216:192.168.202.6@tcp:104: 00010000:00010000:1.0:1789776687.776829:0:15635:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a4441ecc/0x26940258de8f0795 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c4f expref: 8 pid: 15635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776687.776846:0:15635:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86920c2200, rc 0) 00000100:00100000:1.0:1789776687.776904:0:15635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf299f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1367cae-ee96-4b87-865d-1591bdfc1114+8:14531:x1876716462144256:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 5954us (6218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776687.776915:0:15635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 16 00000100:00100000:2.0:1789776687.778250:0:16457:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf2c90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789776687.783176:0:16457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86af5dea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:16457:1876716471561344:192.168.202.6@tcp:105: 00010000:00010000:2.0:1789776687.783261:0:16457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789776687.783343:0:16457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf7bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1367cae-ee96-4b87-865d-1591bdfc1114+7:2357:x1876716462144384:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 7626us (7932us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776687.783358:0:16457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 14 00000100:00100000:3.0:1789776687.784993:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776687.785351:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462144512 00000100:00100000:2.0:1789776687.785365:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462144512 00000100:00100000:2.0:1789776687.785503:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 17 00000100:00100000:2.0:1789776687.785516:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+7:2356:x1876716462144512:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789776687.785861:0:15029:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789776687.785865:0:15029:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789776687 00002000:00010000:2.0:1789776687.785868:0:15029:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789776685 00002000:00010000:2.0:1789776687.785870:0:15029:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789776688 -> 1789776687 00002000:00010000:2.0:1789776687.785873:0:15029:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789776687.785964:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+8:2356:x1876716462144512:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 Request processed in 450us (993us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1789776687.786006:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 17 00000100:00100000:3.0:1789776687.795796:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776687.796710:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462144640 00000100:00100000:0.0:1789776687.796728:0:15031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462144640 00000100:00100000:0.0:1789776687.796815:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 18 00000100:00100000:0.0:1789776687.796827:0:15031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8582a71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1367cae-ee96-4b87-865d-1591bdfc1114+8:2356:x1876716462144640:12345-192.168.202.6@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789776687.796889:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000025d38096/0x26940258de8f079c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776687.796918:0:15031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a4441ecc/0x26940258de8f0795 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c4f expref: 8 pid: 15635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776687.796931:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789776687.796937:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789776687.796942:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025d38096/0x26940258de8f079c lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776687.797001:0:15031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a4441ecc/0x26940258de8f0795 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c4f expref: 8 pid: 15635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776687.797047:0:15031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a4441ecc/0x26940258de8f0795 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c4f expref: 8 pid: 15635 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776687.797353:0:15031:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf7bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15031:1876716471561472:192.168.202.6@tcp:104: 00000100:00100000:0.0:1789776687.797483:0:15031:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8691e44cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776687.807767:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776687.807886:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462144768 00000100:00100000:1.0:1789776687.807900:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462144768 00010000:00010000:1.0:1789776687.807953:0:14334:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a4441ecc/0x26940258de8f0795 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c4f expref: 9 pid: 15635 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776687.808025:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 15 00000100:00100000:1.0:1789776687.808037:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf34fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1367cae-ee96-4b87-865d-1591bdfc1114+9:2356:x1876716462144768:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776687.808069:0:14334:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776687.808100:0:14334:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a4441ecc/0x26940258de8f0795 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c4f expref: 9 pid: 15635 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776687.808119:0:14334:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a4441ecc/0x26940258de8f0795 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c4f expref: 9 pid: 15635 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776687.808159:0:14334:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789776687.808184:0:14334:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789776687.808192:0:14334:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000025d38096/0x26940258de8f079c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776687.808203:0:14334:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025d38096/0x26940258de8f079c lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776687.808281:0:14334:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776687.808350:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf34fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1367cae-ee96-4b87-865d-1591bdfc1114+9:2356:x1876716462144768:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 315us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776687.808360:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 15 00010000:00010000:3.0:1789776687.808882:0:15031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4441ecc/0x26940258de8f0795 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c4f expref: 8 pid: 15635 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776687.808904:0:15031:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf7bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15031:1876716471561472:192.168.202.6@tcp:104: 00010000:00010000:3.0:1789776687.808933:0:15031:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000025d38096/0x26940258de8f079c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776687.808946:0:15031:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000025d38096/0x26940258de8f079c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776687.808954:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025d38096/0x26940258de8f079c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776687.809001:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000025d38096/0x26940258de8f079c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776687.809011:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025d38096/0x26940258de8f079c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776687.809020:0:15031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025d38096/0x26940258de8f079c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776687.809041:0:15031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c86b9b09600 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:3.0:1789776687.809046:0:15031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025d38096/0x26940258de8f079c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776687.809068:0:15031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025d38096/0x26940258de8f079c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776687.809087:0:15031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025d38096/0x26940258de8f079c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776687.809456:0:15031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025d38096/0x26940258de8f079c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776687.809540:0:15031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8582a71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1367cae-ee96-4b87-865d-1591bdfc1114+7:2356:x1876716462144640:12345-192.168.202.6@tcp:1:lhsmtool_posix.0 Request processed in 12713us (13759us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776687.809549:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 18 00000100:00100000:0.0:1789776687.813437:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776687.813827:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462145024 00000100:00100000:2.0:1789776687.813843:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462145024 00000100:00100000:2.0:1789776687.813927:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 60 00000100:00100000:2.0:1789776687.813942:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf34df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1367cae-ee96-4b87-865d-1591bdfc1114+13:14531:x1876716462145024:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789776687.814094:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6600/0x26940258de8f07a3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.814122:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6600/0x26940258de8f07a3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.814138:0:14349:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6600/0x26940258de8f07a3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.814557:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7a00/0x26940258de8f07aa lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.814571:0:14349:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2400/0x26940258de8f0772 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c3a expref: 14 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.814582:0:14349:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7a00/0x26940258de8f07aa lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.814625:0:14349:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2400/0x26940258de8f0772 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c3a expref: 14 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.814642:0:14349:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2400/0x26940258de8f0772 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c3a expref: 14 pid: 14349 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789776687.814675:0:14349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86af5dea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14349:1876716471561600:192.168.202.6@tcp:104: 00000100:00100000:2.0:1789776687.814791:0:14349:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c86bf2c9300 going to sleep for 11 seconds 00000100:00100000:2.0:1789776687.820579:0:14349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86af5dea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14349:1876716471561600:192.168.202.6@tcp:104: 00010000:00010000:2.0:1789776687.821176:0:14349:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7a00/0x26940258de8f07aa lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776687.828441:0:16063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776687.832450:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776687.832603:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462145152 00000100:00100000:1.0:1789776687.832618:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462145152 00010000:00010000:1.0:1789776687.832681:0:14333:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2400/0x26940258de8f0772 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c3a expref: 15 pid: 14349 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789776687.832730:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 16 00000100:00100000:1.0:1789776687.832741:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf34ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1367cae-ee96-4b87-865d-1591bdfc1114+15:2357:x1876716462145152:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789776687.832767:0:14333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789776687.832775:0:14333:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2400/0x26940258de8f0772 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c3a expref: 15 pid: 14349 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776687.832791:0:14333:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2400/0x26940258de8f0772 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c3a expref: 15 pid: 14349 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776687.832823:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86920c2400/0x26940258de8f0772 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c3a expref: 15 pid: 14349 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776687.832868:0:14333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c869055fb00) 00010000:00010000:1.0:1789776687.832874:0:14333:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7a00/0x26940258de8f07aa lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776687.832884:0:14333:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7a00/0x26940258de8f07aa lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776687.832892:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7a00/0x26940258de8f07aa lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776687.832932:0:14333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789776687.833021:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf34ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1367cae-ee96-4b87-865d-1591bdfc1114+14:2357:x1876716462145152:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 280us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776687.833030:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 16 00010000:00010000:0.0:1789776687.833690:0:14349:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7a00/0x26940258de8f07aa lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776687.833703:0:14349:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7a00/0x26940258de8f07aa lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789776687.833965:0:14349:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:0.0:1789776687.834529:0:14349:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:0.0:1789776687.834594:0:14349:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:0.0:1789776687.835710:0:14349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf34f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14349:1876716471561728:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789776687.837393:0:14349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776687.837455:0:14349:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8691e44c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789776687.837537:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471561728 00000100:00100000:1.0:1789776687.837553:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471561728 00000100:00100000:1.0:1789776687.837641:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789776687.837653:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf34f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14349:x1876716471561728:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789776687.837821:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf34f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14349:x1876716471561728:12345-0@lo:1000:mdt00_002.0 Request processed in 169us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776687.837830:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789776687.838804:0:14349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf34f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14349:1876716471561728:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1789776687.839858:0:14349:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:0.0:1789776687.839952:0:14349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf34f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14349:1876716471561856:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789776687.840036:0:14349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776687.840090:0:14349:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8687ecd540 going to sleep for 11 seconds 00000100:00100000:1.0:1789776687.840819:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471561856 00000100:00100000:1.0:1789776687.840829:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471561856 00000100:00100000:1.0:1789776687.840910:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789776687.840920:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf34ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14349:x1876716471561856:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789776687.841150:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf34ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14349:x1876716471561856:12345-0@lo:1000:mdt00_002.0 Request processed in 231us (1113us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1789776687.841182:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789776687.841694:0:14349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf34f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14349:1876716471561856:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1789776687.841962:0:14349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7a00/0x26940258de8f07aa lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776687.841984:0:14349:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7a00/0x26940258de8f07aa lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776687.841993:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7a00/0x26940258de8f07aa lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776687.842000:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc7a00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776687.842004:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7a00/0x26940258de8f07aa lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776687.842014:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7a00/0x26940258de8f07aa lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776687.842033:0:14349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c869055fb00) 00010000:00010000:0.0:1789776687.842038:0:14349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789776687.842044:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7a00/0x26940258de8f07aa lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776687.842051:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7a00/0x26940258de8f07aa lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776687.842090:0:14349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8f0702 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776687.842096:0:14349:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8f0702 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776687.842102:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8f0702 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776687.842117:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681679000 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:0.0:1789776687.842121:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8f0702 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776687.842128:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8f0702 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776687.842137:0:14349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:0.0:1789776687.842140:0:14349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789776687.842148:0:14349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6000/0x26940258de8f0709 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c1e expref: 17 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776687.842171:0:14349:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6000/0x26940258de8f0709 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c1e expref: 17 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776687.842181:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6000/0x26940258de8f0709 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c1e expref: 17 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776687.842267:0:14349:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6000/0x26940258de8f0709 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c1e expref: 17 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789776687.842587:0:14349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf34c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14349:1876716471561984:192.168.202.6@tcp:105: 00000100:00100000:0.0:1789776687.842718:0:14349:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c8687ecd6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789776687.866538:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776687.866674:0:14349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf34c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14349:1876716471561984:192.168.202.6@tcp:105: 00010000:00010000:2.0:1789776687.866718:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8f0702 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.866733:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679000/0x26940258de8f0702 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.866788:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f07b1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.866807:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f07b1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.866821:0:14349:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f07b1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.866834:0:14349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f07b1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.866841:0:14349:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f07b1 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.866848:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f07b1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.866873:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc7200 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776687.866878:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f07b1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.866888:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f07b1 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.866903:0:14349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:2.0:1789776687.866906:0:14349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789776687.866910:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f07b1 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.866917:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc7200/0x26940258de8f07b1 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.866929:0:14349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6600/0x26940258de8f07a3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.866935:0:14349:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6600/0x26940258de8f07a3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.866941:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6600/0x26940258de8f07a3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.866946:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c868afc6600 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:2.0:1789776687.866949:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6600/0x26940258de8f07a3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.866955:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6600/0x26940258de8f07a3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.866987:0:14349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:2.0:1789776687.866990:0:14349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789776687.866994:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6600/0x26940258de8f07a3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.867000:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c868afc6600/0x26940258de8f07a3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776687.867058:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462145280 00000100:00100000:3.0:1789776687.867072:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462145280 00000100:00100000:3.0:1789776687.867148:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 12 00000100:00100000:3.0:1789776687.867174:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf34e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+18:14530:x1876716462145280:12345-192.168.202.6@tcp:49:bash.0 00000100:00100000:3.0:1789776687.867398:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf34e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+18:14530:x1876716462145280:12345-192.168.202.6@tcp:49:bash.0 Request processed in 235us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776687.867407:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 12 00000040:00080000:2.0:1789776687.867508:0:14381:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789776687.867514:0:14381:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789776687.867601:0:14381:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789776687.867607:0:14381:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789776687.867719:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf34df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1367cae-ee96-4b87-865d-1591bdfc1114+17:14531:x1876716462145024:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 53778us (54296us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1789776687.867731:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 60 00000020:00080000:2.0:1789776687.867737:0:14349:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1789776687.895582:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776687.895641:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776687.895737:0:15032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462145664 00000100:00100000:1.0:1789776687.895753:0:15032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462145664 00000100:00100000:3.0:1789776687.895785:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462145536 00000100:00100000:3.0:1789776687.895810:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462145536 00000100:00100000:1.0:1789776687.895846:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 19 00000100:00100000:1.0:1789776687.895861:0:15032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf34ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1367cae-ee96-4b87-865d-1591bdfc1114+7:14530:x1876716462145664:12345-192.168.202.6@tcp:101:bash.0 00000100:00100000:3.0:1789776687.895862:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 13 00000100:00100000:3.0:1789776687.895876:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf34dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+17:14531:x1876716462145536:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 00010000:00010000:1.0:1789776687.895892:0:15032:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789776687.895925:0:15032:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9e0906d/0x26940258de8f07b8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2c56 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789776687.895964:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6aadd32f, atime: 0x6aadd32d, ctime: 0x6aadd32f, blocks: 0x1 00010000:00010000:1.0:1789776687.896000:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1789776687.896007:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789776687.896020:0:15032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9e0906d/0x26940258de8f07b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c56 expref: 8 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776687.896041:0:15032:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f9e0906d/0x26940258de8f07b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c56 expref: 8 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789776687.896059:0:15032:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86920c2400, rc 0) 00000100:00100000:1.0:1789776687.896135:0:15032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf34ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1367cae-ee96-4b87-865d-1591bdfc1114+8:14530:x1876716462145664:12345-192.168.202.6@tcp:101:bash.0 Request processed in 279us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789776687.896143:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 19 00000004:00080000:3.0:1789776687.896783:0:14350:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789776687.896898:0:14350:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:3.0:1789776687.896945:0:14350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8f07bf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776687.896964:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8f07bf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776687.896990:0:14350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8f07bf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776687.897000:0:14350:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8f07bf lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776687.897007:0:14350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8f07bf lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776687.897015:0:14350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8f07bf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776687.897044:0:14350:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789776687.897604:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789776687.897614:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8f07bf lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.897623:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681678800 already unused, calling callback (ffffffffc17aa420) 00010000:00010000:2.0:1789776687.897628:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8f07bf lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.897639:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8f07bf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.897656:0:14336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c869055fb00) 00010000:00010000:2.0:1789776687.897659:0:14336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789776687.897675:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8f07bf lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.897682:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678800/0x26940258de8f07bf lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789776687.897700:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776687.897702:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789776687.897704:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789776687.898253:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf34dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+19:14531:x1876716462145536:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 Request processed in 1256us (1564us total) trans 8589934630 rc 0/0 00000100:00100000:3.0:1789776687.898271:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 13 00000020:00080000:3.0:1789776687.898279:0:14350:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789776687.912737:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776687.912950:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462145920 00000100:00100000:2.0:1789776687.912965:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462145920 00000100:00100000:2.0:1789776687.913062:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 14 00000100:00100000:2.0:1789776687.913076:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf34e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1367cae-ee96-4b87-865d-1591bdfc1114+19:14530:x1876716462145920:12345-192.168.202.6@tcp:35:bash.0 00000001:00080000:2.0:1789776687.913523:0:14351:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:2.0:1789776687.913638:0:14351:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:2.0:1789776687.913788:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf34e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1367cae-ee96-4b87-865d-1591bdfc1114+22:14530:x1876716462145920:12345-192.168.202.6@tcp:35:bash.0 Request processed in 713us (1067us total) trans 8589934633 rc 0/0 00000100:00100000:2.0:1789776687.913798:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 14 00000020:00080000:2.0:1789776687.913805:0:14351:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1789776688.033900:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776688.034145:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462146176 00000100:00100000:3.0:1789776688.034160:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462146176 00000100:00100000:0.0:1789776688.034891:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 61 00000100:00100000:0.0:1789776688.034908:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+22:14541:x1876716462146176:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1789776688.034943:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789776688.034972:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8f07c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf4190e0d006c2c5d expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789776688.035111:0:14347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789776688.035280:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8f07c6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c5d expref: 24 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776688.035299:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c869055f500) 00010000:00010000:0.0:1789776688.035303:0:14347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789776688.035308:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c86b9b08e00/0x26940258de8f07c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xf4190e0d006c2c5d expref: 24 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789776688.035327:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c86b9b08e00, rc 0) 00000100:00080000:2.0:1789776688.035332:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789776688.035423:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+23:14541:x1876716462146176:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 520us (1542us total) trans 8589934634 rc 301/301 00000100:00100000:0.0:1789776688.035432:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 61 00000100:00100000:0.0:1789776688.040692:0:3268:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1789776688.040803:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462146304 00000100:00100000:3.0:1789776688.040839:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462146304 00000100:00100000:3.0:1789776688.040923:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 62 00000100:00100000:3.0:1789776688.040936:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf34d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1367cae-ee96-4b87-865d-1591bdfc1114+23:14541:x1876716462146304:12345-192.168.202.6@tcp:34:lfs.0 00010000:00010000:3.0:1789776688.041083:0:14348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679a00/0x26940258de8f07d4 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776688.041106:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679a00/0x26940258de8f07d4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776688.041120:0:14348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679a00/0x26940258de8f07d4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776688.041139:0:14348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678200/0x26940258de8f07db lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776688.041146:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678200/0x26940258de8f07db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776688.041153:0:14348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678200/0x26940258de8f07db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776688.041529:0:14348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8f07e2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776688.041537:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8f07e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776688.041544:0:14348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8f07e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789776688.041595:0:14348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8f07e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776688.041622:0:14348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679a00/0x26940258de8f07d4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776688.041629:0:14348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679a00/0x26940258de8f07d4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776688.041637:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679a00/0x26940258de8f07d4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776688.041644:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681679a00 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776688.041649:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679a00/0x26940258de8f07d4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776688.041659:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679a00/0x26940258de8f07d4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776688.041673:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c8686bff900) 00010000:00010000:3.0:1789776688.041676:0:14348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776688.041681:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679a00/0x26940258de8f07d4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776688.041688:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679a00/0x26940258de8f07d4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776688.041702:0:14348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678200/0x26940258de8f07db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776688.041708:0:14348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678200/0x26940258de8f07db lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776688.041713:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678200/0x26940258de8f07db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776688.041724:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681678200 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776688.041728:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678200/0x26940258de8f07db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776688.041733:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678200/0x26940258de8f07db lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776688.041741:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9c8682cbef00) 00010000:00010000:3.0:1789776688.041744:0:14348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776688.041746:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678200/0x26940258de8f07db lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776688.041752:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681678200/0x26940258de8f07db lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776688.041765:0:14348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8f07e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776688.041770:0:14348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8f07e2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776688.041775:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8f07e2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776688.041780:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c8681679200 already unused, calling callback (ffffffffc21c34f0) 00010000:00010000:3.0:1789776688.041783:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8f07e2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776688.041788:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8f07e2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776688.041803:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c8682cbeb00) 00010000:00010000:3.0:1789776688.041805:0:14348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789776688.041808:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8f07e2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789776688.041814:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c8681679200/0x26940258de8f07e2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789776688.041910:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf34d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1367cae-ee96-4b87-865d-1591bdfc1114+23:14541:x1876716462146304:12345-192.168.202.6@tcp:34:lfs.0 Request processed in 975us (1244us total) trans 0 rc 0/0 00000100:00100000:3.0:1789776688.041919:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 62 00000100:00100000:1.0:1789776688.045467:0:3267:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1789776688.045587:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462146560 00000100:00100000:2.0:1789776688.045602:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462146560 00000100:00100000:2.0:1789776688.045678:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 15 00000100:00100000:2.0:1789776688.045693:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1367cae-ee96-4b87-865d-1591bdfc1114+23:14541:x1876716462146560:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:2.0:1789776688.046056:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1367cae-ee96-4b87-865d-1591bdfc1114+24:14541:x1876716462146560:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 368us (602us total) trans 8589934635 rc 0/0 00000100:00100000:2.0:1789776688.046063:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 15 00010000:00010000:2.0:1789776688.852911:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789776689.876451:0:16063:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789776690.068480:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789776690.068514:0:3275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c86bf34f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471562112:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789776690.068632:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789776690.068865:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716471562112 00000100:00100000:0.0:1789776690.068874:0:15033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716471562112 00000100:00100000:0.0:1789776690.068951:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789776690.068974:0:15033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86bf34d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471562112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789776690.069046:0:15033:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789776690.069106:0:15033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86bf34d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1876716471562112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789776690.069114:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1789776690.069139:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789776690.069188:0:3275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c86bf34f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3275:1876716471562112:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1789776690.208407:0:16609:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:2.0:1789776690.900773:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789776690.974779:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1789776690.974842:0:3266:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1789776690.974900:0:15035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462146688 00000100:00100000:0.0:1789776690.974915:0:15035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462146688 00000100:00100000:2.0:1789776690.974993:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876716462146816 00000100:00100000:2.0:1789776690.974998:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876716462146816 00002000:00100000:0.0:1789776690.975008:0:15035:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff9c86babc0000 x1876716462146688/t0(0) o4->a1367cae-ee96-4b87-865d-1591bdfc1114@192.168.202.6@tcp:126/0 lens 504/0 e 0 to 0 dl 1789776701 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1789776690.975019:0:15035:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c86babc0000 with x1876716462146688 ext(0->8) 00002000:00010000:0.0:1789776690.975026:0:15035:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c86babc0000 00000100:00100000:2.0:1789776690.975051:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 20 00000100:00100000:0.0:1789776690.975053:0:15035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 0 00000100:00100000:2.0:1789776690.975062:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+9:2354:x1876716462146816:12345-192.168.202.6@tcp:16:kworker.0 00000100:00100000:0.0:1789776690.975062:0:15035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c86babc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+9:2354:x1876716462146688:12345-192.168.202.6@tcp:4:bash.0 00000100:00100000:2.0:1789776690.975260:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+9:2354:x1876716462146816:12345-192.168.202.6@tcp:16:kworker.0 Request processed in 154us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789776690.975269:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 20 00000100:00100000:0.0:1789776690.975782:0:15035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c86babc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a1367cae-ee96-4b87-865d-1591bdfc1114+10:2354:x1876716462146688:12345-192.168.202.6@tcp:4:bash.0 Request processed in 720us (1017us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1789776690.975791:0:15035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 0 00002000:00100000:0.0:1789776690.975799:0:15035:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff9c86babc0000 x1876716462146688/t8589934598(0) o4->a1367cae-ee96-4b87-865d-1591bdfc1114@192.168.202.6@tcp:126/0 lens 504/448 e 0 to 0 dl 1789776701 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1789776690.975808:0:15035:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c86babc0000 with x1876716462146688 ext(0->8) 00002000:00010000:0.0:1789776690.975812:0:15035:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c86babc0000 00000100:00080000:1.0:1789776690.979594:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789776691.934251:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29828 lines, 29828 kept, 0 dropped, 0 bad.